-- Logs begin at Wed 2022-08-31 10:22:25 UTC, end at Wed 2022-08-31 11:46:04 UTC. -- Aug 31 10:57:21.082791 dv-cinder-855350-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 10:57:21.090201 dv-cinder-855350-1-smb devstack@keystone.service[81869]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 10:57:21 2022] *** Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: nodename: dv-cinder-855350-1-smb Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: machine: x86_64 Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: clock source: unix Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: pcre jit disabled Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: detected number of CPU cores: 4 Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: current working directory: / Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: detected binary path: /usr/bin/uwsgi-core Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: your processes number limit is 47680 Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: your memory page size is 4096 bytes Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: detected max file descriptor number: 2048 Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: lock engine: pthread robust mutexes Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: thunder lock: enabled Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 10:57:21.094576 dv-cinder-855350-1-smb devstack@keystone.service[81869]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 10:57:21.134681 dv-cinder-855350-1-smb devstack@keystone.service[81869]: Python main interpreter initialized at 0x5593313b89c0 Aug 31 10:57:21.134681 dv-cinder-855350-1-smb devstack@keystone.service[81869]: python threads support enabled Aug 31 10:57:21.134681 dv-cinder-855350-1-smb devstack@keystone.service[81869]: your server socket listen backlog is limited to 100 connections Aug 31 10:57:21.134681 dv-cinder-855350-1-smb devstack@keystone.service[81869]: your mercy for graceful operations on workers is 90 seconds Aug 31 10:57:21.135066 dv-cinder-855350-1-smb devstack@keystone.service[81869]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 10:57:21.135145 dv-cinder-855350-1-smb devstack@keystone.service[81869]: *** Operational MODE: preforking *** Aug 31 10:57:21.135396 dv-cinder-855350-1-smb devstack@keystone.service[81869]: *** uWSGI is running in multiple interpreter mode *** Aug 31 10:57:21.135396 dv-cinder-855350-1-smb devstack@keystone.service[81869]: spawned uWSGI master process (pid: 81869) Aug 31 10:57:21.135626 dv-cinder-855350-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 10:57:21.136267 dv-cinder-855350-1-smb devstack@keystone.service[81869]: spawned uWSGI worker 1 (pid: 81883, cores: 1) Aug 31 10:57:21.136556 dv-cinder-855350-1-smb devstack@keystone.service[81869]: spawned uWSGI worker 2 (pid: 81884, cores: 1) Aug 31 10:57:21.139176 dv-cinder-855350-1-smb devstack@keystone.service[81869]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 10:57:25.574509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:57:25.574509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: from cryptography.utils import int_from_bytes Aug 31 10:57:25.575320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:57:25.575320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: from cryptography.utils import int_from_bytes Aug 31 10:57:25.576403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:57:25.576403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: from cryptography.utils import int_from_bytes Aug 31 10:57:25.576861 dv-cinder-855350-1-smb devstack@keystone.service[81883]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:57:25.576861 dv-cinder-855350-1-smb devstack@keystone.service[81883]: from cryptography.utils import int_from_bytes Aug 31 10:57:25.626663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:57:25.626874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:57:25.627031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] command line args: [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:57:25.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:57:25.627478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ================================================================================ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:57:25.627732 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] admin_token = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.628319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] config_dir = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.628516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.628704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] config_source = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.628838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:57:25.628925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] debug = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.629001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:57:25.629082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.629321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] command line args: [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:57:25.629389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:57:25.629451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.629591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ================================================================================ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:57:25.629680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.629829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] admin_token = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.629911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config_dir = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config_source = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_config_append = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] debug = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_dir = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.630983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_file = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.631996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.632076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.632152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_config_append = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.632301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.632434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.632434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_dir = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.632686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.632807 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.632926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.633045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.633164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.633289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.633415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.633541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.633620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.633695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.633816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.633897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.634983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] publish_errors = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.635109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.635220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.635330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.635438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.635542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.635661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.635791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.635915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.636026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.636136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.636300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] standard_threads = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.636519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.636638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.636747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] publish_errors = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.636878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.636999 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.637110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.637225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_journal = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.637335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.637450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_json = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.637568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.637679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_stderr = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.637788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.637896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_syslog = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.637896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.638110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.638110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] standard_threads = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.638329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.638439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.638554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.638669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.638784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.638894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.639011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_journal = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_json = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.639339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.639455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_stderr = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.639640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.639774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_syslog = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.639884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.639984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:57:25.640078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.640177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.640270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.640362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.640452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.640549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.640641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.640748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.640848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.640947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641432 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.641934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.642032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.642175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.642277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.642416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.642517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.642670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.642772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.642915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.643023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.643168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.643270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.643422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.643522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.643705 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.643902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.644039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.644174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.644305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.644413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.644563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.644664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.644941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.645047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.645219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.645315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.645443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.645528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.645674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.645749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.645927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.646009 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.646178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.646259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.646420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.646506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.646665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.646830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.646976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.647093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.647211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.647323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.647323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.647575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.647699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.647842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.647963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.648084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.648196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.648311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.648424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.648586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.648786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.648961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.649154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.649332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.649514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.649677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.649882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.650071 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.650246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.650414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.650579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.650732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.650869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.651036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.651184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.651340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.651499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.651659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.651868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.652061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.652236 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.652412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.652600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.652775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.652941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.653111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.653283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.653450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.653628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.653805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.653970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.654137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.654317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.654481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.654645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.654809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.654974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.655157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.655323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.655507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.655675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.655858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.656027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.656180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.656332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.656498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.656647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.656791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.656937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.657083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.657237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.657391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.657536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.657680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.657831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.657977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.658142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.658298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.658451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.658611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.658762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.658918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.659082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.659763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.659922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.660075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.660231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.660383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.660537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.660962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.661137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.661294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.661445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.661596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.661752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.661916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.662074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.662228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.662379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.662527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.662672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.662853 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.663029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.663191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.663355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.663512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.663676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.663957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.664142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.664323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.664496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.664665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.664832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.665000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.665181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.665445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.665604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.665782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.665965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.665965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.666328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.666511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.666695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.666877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.667058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.667285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.667464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.667619 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.667820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.667975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.668139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.668298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.668464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.668659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.668844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.669007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.669174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.669320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.669472 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.669618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.669771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.669919 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.670064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.670212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.670372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.670525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.external = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.670681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.670837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.670996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.670996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.671287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.671435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.671591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.671772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.671880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.password = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.token = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.external = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.672309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.673055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.673149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.password = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.673149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.token = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.673334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.673428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.673529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.673672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.673793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.673920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.674039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.674158 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.674271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.674394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.674509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.674629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.674749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.675475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.675599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.676331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.677830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.677968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.678086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.678190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.678303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.678416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.678529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.678651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.678765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.678880 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.679037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.679154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.679267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.679389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.679504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.679617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.680470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.680590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.680703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.680904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.681946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.682168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.682287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.682287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.682499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.682611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.682724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.682837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.682837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.683427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.683526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.683526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.683703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.686185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.686185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.691797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.691902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.692948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693751 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.693998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.694921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695483 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695882 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.695941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.696963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697530 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697845 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.697926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.698980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.699999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700521 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.700955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701263 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701602 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.701958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702016 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.702942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703117 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.703716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] role.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] role.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704585 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.704954 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.705909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706138 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706861 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.706982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.707953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.708012 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.708070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.708471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.708716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.708994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.709241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.709496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.709752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.709993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.710255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.710497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.710577 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.710743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.710864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.710983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.711118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.711225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.711370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.711467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.711620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.711726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.711908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.712000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.712155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.712233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.712427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.712505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.712686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.712766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.712930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.713006 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.713174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.713252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.713419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.713499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.713677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.713755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.713920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.713997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.714184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.714263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.714439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.714517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.714684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.714761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.714936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.715014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.715184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.715261 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.715429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.715539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.715669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.715790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.715911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.716011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.716154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.716235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.716408 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.716486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.716695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.716780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.716933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.717019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.717168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.717246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.717408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.717494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.717647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.717725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.717888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.717965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.718133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.718304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.718381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.718452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.718603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.718682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.718844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.718930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.719091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.719167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.719326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.719450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.719564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.719650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.719837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.719921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.720065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.720143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.720302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.720392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.720459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:57:25.720532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.720778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.721020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.721271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.721509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.722340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.722725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:57:25.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:57:25.752207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.752438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.752663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.755211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.755369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.755599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.761182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.766296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.794652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.794852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.795805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.796041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.863054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.863309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.919063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.919255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.919337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:25.919438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.094983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.095189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.095411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.095629 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.095868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.096084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.096659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.097508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.097889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.098205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.098562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.098858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.126983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.127150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.127235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.127334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.127413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.127557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.127645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.127803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.127948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.128033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.128109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.128254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.128397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.128529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.148040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.148433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.162140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.162364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.162454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.162589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.162673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.162811 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.162892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.163028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.163118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.163241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.163323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.163461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.163541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.163673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:57:26.181615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.181824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:57:26.182160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.182300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.182425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:57:26.182570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:57:26.182687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.182837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.183015 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.183132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:57:26.183247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.183374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.183487 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.183597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.184162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.184424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.194118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.194411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.194686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.194972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.195091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.195302 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.195578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.196029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.203424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.206747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.207049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.207457 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.207953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.208240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.208520 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.208781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.209049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.209324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.209723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.209998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.210267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.212450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.212955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.213587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.213980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.214492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.214934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.215332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.215623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.215936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.216428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.216798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.233900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.235392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.235679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.240150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.240465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.240753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.241035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.241642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.241932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.246547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.246839 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.247160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.247510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.247832 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.251963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.252252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.252535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.252813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.253674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.253957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.254214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.254350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.254488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.254648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.258656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.258972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.259235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.259515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.259811 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.262022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.262316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.262602 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.272942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.273237 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.277157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.279002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.279301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.280450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.281231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.283353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.285293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.286731 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.287030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.288453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.291412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.291651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.291972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.292257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.292550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.293027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.293166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.294683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.297796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.298096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.298379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.298672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.298951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.299336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.309939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.310232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.310499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.310775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.317480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.317779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.318048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.318312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.318399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.319867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.321461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.321730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.324395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.324689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.325094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.325178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.325378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.325676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.326788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.328365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.328639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.331313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.332191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.332191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.332346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.332560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.337251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.337543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.337923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.338238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.339461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.339461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.339461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.344043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.344357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.344642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.344924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.345205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.345479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.345774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.354708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.357670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.360621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.361668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.362057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.364280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.364603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.364884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.365462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.368380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.369827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.371317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.371434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.371597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.371901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.373107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.376111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.376401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.376680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.376953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.379706 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.381165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.384259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.384538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.384827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.385118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.386366 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.386664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.386949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.393147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.393447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.394087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.394200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.394532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.394830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.395109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.395386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.395699 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.396006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.396282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.396593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.396875 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.397142 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.397403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.397709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.397988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.401653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:57:26.401949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.408764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.408764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.408764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.408764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.408764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.408764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.408764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.409296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.409296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.409296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.409296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.409296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:57:26.435050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5593313b89c0 pid: 81883 (default app) Aug 31 10:57:26.438656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1bd8a-9cfe-4a47-9bd5-3d6e165cc620 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:26.438970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1bd8a-9cfe-4a47-9bd5-3d6e165cc620 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:26.439242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1bd8a-9cfe-4a47-9bd5-3d6e165cc620 None None] PATH_INFO: `/v3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:26.448733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5593313b89c0 pid: 81884 (default app) Aug 31 10:57:26.448849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Wed Aug 31 10:57:26 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:34.339001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b62115-83dd-4bce-a08b-dc7ccb9a89f2 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:34.339553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b62115-83dd-4bce-a08b-dc7ccb9a89f2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:34.339942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b62115-83dd-4bce-a08b-dc7ccb9a89f2 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:34.344404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:57:34.351210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:34.351718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:34.351839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:34.422851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: INFO dbcounter [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] Registered counter for database keystone Aug 31 10:57:34.442773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG oslo_db.sqlalchemy.engines [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:57:34.449145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writer thread running {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:57:34.763781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG passlib.handlers.bcrypt [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81883) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 10:57:34.764187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG passlib.handlers.bcrypt [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81883) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 10:57:34.824907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:34.826537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:34.975101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 625 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 10:57:35.454770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b62115-83dd-4bce-a08b-dc7ccb9a89f2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:35.526024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: INFO dbcounter [None req-62b62115-83dd-4bce-a08b-dc7ccb9a89f2 None None] Registered counter for database keystone Aug 31 10:57:35.547729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG oslo_db.sqlalchemy.engines [None req-62b62115-83dd-4bce-a08b-dc7ccb9a89f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:57:35.554626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writer thread running {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:57:35.678393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b62115-83dd-4bce-a08b-dc7ccb9a89f2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:35.682778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6fb67-ac8d-4754-8da5-d0f575d78620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:35.683411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6fb67-ac8d-4754-8da5-d0f575d78620 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:35.683692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6fb67-ac8d-4754-8da5-d0f575d78620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:35.683992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6fb67-ac8d-4754-8da5-d0f575d78620 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:35.693375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6fb67-ac8d-4754-8da5-d0f575d78620 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:35.746297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eff6fb67-ac8d-4754-8da5-d0f575d78620 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 10:57:35.746641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6fb67-ac8d-4754-8da5-d0f575d78620 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:35.757227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Aug 31 10:57:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 10:57:35.763242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:35.779257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f52315-c1da-44ce-8695-7bd65aa8580b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:35.783937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f34ddd-785f-4531-a9e1-1b7d1fde15ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:35.785692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f34ddd-785f-4531-a9e1-1b7d1fde15ad admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:35.785980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f34ddd-785f-4531-a9e1-1b7d1fde15ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:35.786253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f34ddd-785f-4531-a9e1-1b7d1fde15ad admin admin] PATH_INFO: `/v3/projects/fa445d84b8134f39a7735cb2fc7c685b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:35.787929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f34ddd-785f-4531-a9e1-1b7d1fde15ad admin admin] RBAC: Authorizing `identity:get_project(project_id=fa445d84b8134f39a7735cb2fc7c685b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:35.842457 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING keystone.common.rbac_enforcer.enforcer [None req-73f34ddd-785f-4531-a9e1-1b7d1fde15ad admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 10:57:35.842718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f34ddd-785f-4531-a9e1-1b7d1fde15ad admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:35.848568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Aug 31 10:57:35 2022] GET /identity/v3/projects/fa445d84b8134f39a7735cb2fc7c685b => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:37.830632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edea10-88bd-4c19-87ca-b41b753746dc None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:37.831161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edea10-88bd-4c19-87ca-b41b753746dc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:37.831248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edea10-88bd-4c19-87ca-b41b753746dc None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:37.835585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:37.841665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b54bb2-00d1-4511-bc48-f9cf2a1eab87 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:37.842144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b54bb2-00d1-4511-bc48-f9cf2a1eab87 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:37.842227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b54bb2-00d1-4511-bc48-f9cf2a1eab87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:37.864549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-74b54bb2-00d1-4511-bc48-f9cf2a1eab87 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:37.866101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-74b54bb2-00d1-4511-bc48-f9cf2a1eab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:37.874239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 10:57:38.157051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edea10-88bd-4c19-87ca-b41b753746dc None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:38.161150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edea10-88bd-4c19-87ca-b41b753746dc None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:38.165598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6fda-3345-4bb5-a802-33f724ca7e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:38.166195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6fda-3345-4bb5-a802-33f724ca7e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:38.166469 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6fda-3345-4bb5-a802-33f724ca7e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:38.166735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6fda-3345-4bb5-a802-33f724ca7e1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:38.175123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6fda-3345-4bb5-a802-33f724ca7e1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:38.177245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6fda-3345-4bb5-a802-33f724ca7e1f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:38.191242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Aug 31 10:57:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:57:38.197048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b54bb2-00d1-4511-bc48-f9cf2a1eab87 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:38.206672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b54bb2-00d1-4511-bc48-f9cf2a1eab87 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:38.211174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e99ee3-9f66-4ff8-8da4-4b4ffa8058af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:38.211862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99ee3-9f66-4ff8-8da4-4b4ffa8058af admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:38.212157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99ee3-9f66-4ff8-8da4-4b4ffa8058af admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:38.212420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99ee3-9f66-4ff8-8da4-4b4ffa8058af admin admin] PATH_INFO: `/v3/users/4130eba1ceda435c8baed39723df5c8e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:38.213722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e99ee3-9f66-4ff8-8da4-4b4ffa8058af admin admin] RBAC: Authorizing `identity:get_user(user_id=4130eba1ceda435c8baed39723df5c8e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:38.215625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e99ee3-9f66-4ff8-8da4-4b4ffa8058af admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:38.217188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Aug 31 10:57:38 2022] GET /identity/v3/users/4130eba1ceda435c8baed39723df5c8e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:40.309910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033780-9b1d-4582-bf96-6107674e7914 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:40.309910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033780-9b1d-4582-bf96-6107674e7914 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:40.309910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9033780-9b1d-4582-bf96-6107674e7914 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:40.309910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:40.310690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e5ed-242b-49c3-a380-68c2d86d1a0e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:40.310690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e5ed-242b-49c3-a380-68c2d86d1a0e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:40.310690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e5ed-242b-49c3-a380-68c2d86d1a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:40.313825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ca23f-ae29-4773-8e51-99e7c70325c6 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:40.314103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ca23f-ae29-4773-8e51-99e7c70325c6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:40.314372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ca23f-ae29-4773-8e51-99e7c70325c6 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:40.316486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:57:40.321926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96144161-6711-440a-b565-41b6c1a2bccf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:40.322197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96144161-6711-440a-b565-41b6c1a2bccf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:40.322463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96144161-6711-440a-b565-41b6c1a2bccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:40.324186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3f43e5ed-242b-49c3-a380-68c2d86d1a0e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:40.325376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3f43e5ed-242b-49c3-a380-68c2d86d1a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:40.366124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG passlib.handlers.bcrypt [None req-96144161-6711-440a-b565-41b6c1a2bccf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81884) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 10:57:40.366491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG passlib.handlers.bcrypt [None req-96144161-6711-440a-b565-41b6c1a2bccf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81884) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 10:57:40.416930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-96144161-6711-440a-b565-41b6c1a2bccf None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:40.418518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-96144161-6711-440a-b565-41b6c1a2bccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:40.424148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:40.524950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:57:40.699470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e5ed-242b-49c3-a380-68c2d86d1a0e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:40.724762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:40.795262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96144161-6711-440a-b565-41b6c1a2bccf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:40.823961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e5ed-242b-49c3-a380-68c2d86d1a0e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:40.861146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea75d9-02f3-45ec-a560-49d0b390a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:40.861785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea75d9-02f3-45ec-a560-49d0b390a463 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:40.862063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea75d9-02f3-45ec-a560-49d0b390a463 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:40.862899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea75d9-02f3-45ec-a560-49d0b390a463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:40.875037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea75d9-02f3-45ec-a560-49d0b390a463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-faea75d9-02f3-45ec-a560-49d0b390a463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:57:40.883900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:57:40.884892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:57:40.885821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:57:40.890953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea75d9-02f3-45ec-a560-49d0b390a463 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:40.903248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96144161-6711-440a-b565-41b6c1a2bccf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:40.905648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:40.948778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f11b9-9dce-41d4-96c7-120abd441cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:40.950329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f11b9-9dce-41d4-96c7-120abd441cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:40.950739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f11b9-9dce-41d4-96c7-120abd441cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:40.951026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f11b9-9dce-41d4-96c7-120abd441cc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:40.983201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:41.008123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea75d9-02f3-45ec-a560-49d0b390a463 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:41.033407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f11b9-9dce-41d4-96c7-120abd441cc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:41.035684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f11b9-9dce-41d4-96c7-120abd441cc6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:41.045273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82530ce-a5a7-4ea8-a851-c56354b91c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:41.045975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82530ce-a5a7-4ea8-a851-c56354b91c94 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:41.046330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82530ce-a5a7-4ea8-a851-c56354b91c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:41.046633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82530ce-a5a7-4ea8-a851-c56354b91c94 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:41.047313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82530ce-a5a7-4ea8-a851-c56354b91c94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:41.047614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82530ce-a5a7-4ea8-a851-c56354b91c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:41.049058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82530ce-a5a7-4ea8-a851-c56354b91c94 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:41.064965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:41.070730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82530ce-a5a7-4ea8-a851-c56354b91c94 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:41.156333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:57:41.163575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f11b9-9dce-41d4-96c7-120abd441cc6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:41.166572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:41.179598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82530ce-a5a7-4ea8-a851-c56354b91c94 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:41.218501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf0295-bb90-450e-ba68-067bba60e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:41.219046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf0295-bb90-450e-ba68-067bba60e4ff None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:41.219319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf0295-bb90-450e-ba68-067bba60e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:41.219589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf0295-bb90-450e-ba68-067bba60e4ff None admin] PATH_INFO: `/v3/users/4130eba1ceda435c8baed39723df5c8e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:41.220776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf0295-bb90-450e-ba68-067bba60e4ff None admin] RBAC: Authorizing `identity:get_user(user_id=4130eba1ceda435c8baed39723df5c8e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:41.222807 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf0295-bb90-450e-ba68-067bba60e4ff None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:41.224446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:57:41 2022] GET /identity/v3/users/4130eba1ceda435c8baed39723df5c8e => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:41.230091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf0295-bb90-450e-ba68-067bba60e4ff None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:41.245336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:41.272255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f11b9-9dce-41d4-96c7-120abd441cc6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:41.324346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4c12-966c-4d1d-8ab0-1ec82935b146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:41.325261 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4c12-966c-4d1d-8ab0-1ec82935b146 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:41.325499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4c12-966c-4d1d-8ab0-1ec82935b146 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:41.325772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4c12-966c-4d1d-8ab0-1ec82935b146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:41.339613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf0295-bb90-450e-ba68-067bba60e4ff None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:41.346094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd4c12-966c-4d1d-8ab0-1ec82935b146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:41.348222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd4c12-966c-4d1d-8ab0-1ec82935b146 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f1dd4c12-966c-4d1d-8ab0-1ec82935b146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:57:41.368211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:57:41.369255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:57:41.370047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:57:41.370047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:57:41.370047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:57:41.370047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:57:41.375351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4c12-966c-4d1d-8ab0-1ec82935b146 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:41.377170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeb60b-8fba-4416-8e13-669c3d7c9359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:41.378406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeb60b-8fba-4416-8e13-669c3d7c9359 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:41.378682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeb60b-8fba-4416-8e13-669c3d7c9359 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:41.378993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeb60b-8fba-4416-8e13-669c3d7c9359 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:41.380736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beeb60b-8fba-4416-8e13-669c3d7c9359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:41.383287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beeb60b-8fba-4416-8e13-669c3d7c9359 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:41.386035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:57:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:41.391965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeb60b-8fba-4416-8e13-669c3d7c9359 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:41.442208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:41.482486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:41.493189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4c12-966c-4d1d-8ab0-1ec82935b146 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:41.503504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeb60b-8fba-4416-8e13-669c3d7c9359 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:41.529061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f6ee3-1382-4558-baf8-0aad6c349262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:41.529678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f6ee3-1382-4558-baf8-0aad6c349262 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:41.529949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f6ee3-1382-4558-baf8-0aad6c349262 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:41.530215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f6ee3-1382-4558-baf8-0aad6c349262 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:41.530862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f6ee3-1382-4558-baf8-0aad6c349262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:41.531162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f6ee3-1382-4558-baf8-0aad6c349262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:41.532581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f6ee3-1382-4558-baf8-0aad6c349262 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:41.540786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0a47a-efed-4b61-975e-2d1a897dcc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:41.541401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0a47a-efed-4b61-975e-2d1a897dcc67 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:41.541681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0a47a-efed-4b61-975e-2d1a897dcc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:41.541962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0a47a-efed-4b61-975e-2d1a897dcc67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:41.542691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0a47a-efed-4b61-975e-2d1a897dcc67 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.domain.id=default, user.id=4130eba1ceda435c8baed39723df5c8e) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:41.543005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0a47a-efed-4b61-975e-2d1a897dcc67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:41.544503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0a47a-efed-4b61-975e-2d1a897dcc67 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:41.550490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:41.552362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 11/21] 10.222.0.13 () {56 vars in 1322 bytes} [Wed Aug 31 10:57:41 2022] GET /identity/v3/role_assignments?user.id=4130eba1ceda435c8baed39723df5c8e&scope.domain.id=default&role.id=55aed406476a485f99f9815f9f27cb3b => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:43.974532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f73b7-b66c-409f-9d3b-de84dfd61cdc None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:43.975077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f73b7-b66c-409f-9d3b-de84dfd61cdc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:43.975354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f73b7-b66c-409f-9d3b-de84dfd61cdc None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:43.977997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:43.984312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1fd26-b53f-48d1-8ad5-ca70299d35da None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:43.984775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1fd26-b53f-48d1-8ad5-ca70299d35da None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:43.985137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1fd26-b53f-48d1-8ad5-ca70299d35da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:44.019877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8ab1fd26-b53f-48d1-8ad5-ca70299d35da None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:44.021252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8ab1fd26-b53f-48d1-8ad5-ca70299d35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:44.106200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f102-7d28-4201-bc0f-794ec7a5d38f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:44.106557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f102-7d28-4201-bc0f-794ec7a5d38f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:44.106762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f102-7d28-4201-bc0f-794ec7a5d38f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:44.108354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 12/23] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:44.113931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3844-4c9e-4c5d-b7cf-c8a87c1b7373 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:44.114211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3844-4c9e-4c5d-b7cf-c8a87c1b7373 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:44.114476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3844-4c9e-4c5d-b7cf-c8a87c1b7373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:44.139350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 12/24] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:44.144038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-831e3844-4c9e-4c5d-b7cf-c8a87c1b7373 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:44.145084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-831e3844-4c9e-4c5d-b7cf-c8a87c1b7373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:44.249195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:44.416316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951cb8f-2aae-4933-8feb-5b6a80574f6d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:44.416985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951cb8f-2aae-4933-8feb-5b6a80574f6d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:44.417460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951cb8f-2aae-4933-8feb-5b6a80574f6d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:44.419043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 13/26] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:44.425250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ef80-14d1-477b-92ed-4b1a9856f3fe None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:44.425632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ef80-14d1-477b-92ed-4b1a9856f3fe None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:44.425912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ef80-14d1-477b-92ed-4b1a9856f3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:44.462986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f656ef80-14d1-477b-92ed-4b1a9856f3fe None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:44.464212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f656ef80-14d1-477b-92ed-4b1a9856f3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:44.525756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:44.558198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 14/27] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:44.571638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c318-d16b-4903-a02f-a2cec2973e42 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:44.572257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c318-d16b-4903-a02f-a2cec2973e42 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:44.572738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c318-d16b-4903-a02f-a2cec2973e42 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:44.574272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 14/28] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:44.585392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2910b5-775a-48bb-ac7e-d0ed69770bbf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:44.585681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2910b5-775a-48bb-ac7e-d0ed69770bbf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:44.585943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2910b5-775a-48bb-ac7e-d0ed69770bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:44.614195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0f2910b5-775a-48bb-ac7e-d0ed69770bbf None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:44.615397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0f2910b5-775a-48bb-ac7e-d0ed69770bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:44.712507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 15/29] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:44.714512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c318-d16b-4903-a02f-a2cec2973e42 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:44.826497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:44.858933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c318-d16b-4903-a02f-a2cec2973e42 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:44.909892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2910b5-775a-48bb-ac7e-d0ed69770bbf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:44.917052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641838-3be6-4f8f-912a-b378b3bb4eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:44.917688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641838-3be6-4f8f-912a-b378b3bb4eae None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:44.917971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641838-3be6-4f8f-912a-b378b3bb4eae None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:44.918247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641838-3be6-4f8f-912a-b378b3bb4eae None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:44.918940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641838-3be6-4f8f-912a-b378b3bb4eae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:44.920388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641838-3be6-4f8f-912a-b378b3bb4eae None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:45.107957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2910b5-775a-48bb-ac7e-d0ed69770bbf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:45.124118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:45.165058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017b555-ff1d-4b7d-871b-e8427dd27f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:45.165718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017b555-ff1d-4b7d-871b-e8427dd27f55 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:45.165993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017b555-ff1d-4b7d-871b-e8427dd27f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:45.166259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017b555-ff1d-4b7d-871b-e8427dd27f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:45.175696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 15/30] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Aug 31 10:57:44 2022] POST /identity/v3/roles => generated 219 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:57:45.178829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641838-3be6-4f8f-912a-b378b3bb4eae None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:45.189284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017b555-ff1d-4b7d-871b-e8427dd27f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:45.191485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017b555-ff1d-4b7d-871b-e8427dd27f55 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-7017b555-ff1d-4b7d-871b-e8427dd27f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:57:45.236501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:57:45.239363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:57:45.241330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:57:45.241330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:57:45.241330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:57:45.241330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 16/31] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:57:45.241330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017b555-ff1d-4b7d-871b-e8427dd27f55 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:45.391616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641838-3be6-4f8f-912a-b378b3bb4eae None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:45.435788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31f9d1-16b4-4192-ba18-1eb0430fe71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:45.436801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31f9d1-16b4-4192-ba18-1eb0430fe71a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:45.437532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31f9d1-16b4-4192-ba18-1eb0430fe71a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:45.438012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31f9d1-16b4-4192-ba18-1eb0430fe71a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:45.441555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:45.458642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31f9d1-16b4-4192-ba18-1eb0430fe71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1e31f9d1-16b4-4192-ba18-1eb0430fe71a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:57:45.465653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:57:45.466694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:57:45.467625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:57:45.469797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 16/32] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:57:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:57:45.471163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31f9d1-16b4-4192-ba18-1eb0430fe71a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:45.505678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017b555-ff1d-4b7d-871b-e8427dd27f55 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:45.549782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e342827-c2ac-427f-90df-be644b477bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:45.550803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e342827-c2ac-427f-90df-be644b477bfa None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:45.551279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e342827-c2ac-427f-90df-be644b477bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:45.552232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e342827-c2ac-427f-90df-be644b477bfa None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:45.552979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e342827-c2ac-427f-90df-be644b477bfa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:45.554574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e342827-c2ac-427f-90df-be644b477bfa None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:45.624398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31f9d1-16b4-4192-ba18-1eb0430fe71a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:45.662060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7c4e4-6f2f-4c5d-a457-7f3364821584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:45.662590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7c4e4-6f2f-4c5d-a457-7f3364821584 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:45.662870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7c4e4-6f2f-4c5d-a457-7f3364821584 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:45.663145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7c4e4-6f2f-4c5d-a457-7f3364821584 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:45.663843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7c4e4-6f2f-4c5d-a457-7f3364821584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:45.664149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7c4e4-6f2f-4c5d-a457-7f3364821584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:45.665672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7c4e4-6f2f-4c5d-a457-7f3364821584 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:45.685351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 17/33] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:45.686465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7c4e4-6f2f-4c5d-a457-7f3364821584 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:45.762004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:45.783632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 17/34] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Aug 31 10:57:45 2022] POST /identity/v3/roles => generated 225 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:57:45.785600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c470427-0a06-4785-80c1-784d1f524e2d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:45.785889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c470427-0a06-4785-80c1-784d1f524e2d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:45.786167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c470427-0a06-4785-80c1-784d1f524e2d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:45.787495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 18/35] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:45.788290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c470427-0a06-4785-80c1-784d1f524e2d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:45.812830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:45.832391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7c4e4-6f2f-4c5d-a457-7f3364821584 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:45.876124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326bb61-aab7-4312-ab45-826415e3e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:45.877241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326bb61-aab7-4312-ab45-826415e3e0de None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:45.878491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326bb61-aab7-4312-ab45-826415e3e0de None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:45.879542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326bb61-aab7-4312-ab45-826415e3e0de None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:45.892456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326bb61-aab7-4312-ab45-826415e3e0de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:45.892456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326bb61-aab7-4312-ab45-826415e3e0de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:45.892456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326bb61-aab7-4312-ab45-826415e3e0de None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:45.904976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 18/36] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:57:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:45.907567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e364c14-da44-493f-a508-79fc7064f627 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:45.908289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e364c14-da44-493f-a508-79fc7064f627 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:45.908801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e364c14-da44-493f-a508-79fc7064f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:45.935799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5e364c14-da44-493f-a508-79fc7064f627 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:45.937357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5e364c14-da44-493f-a508-79fc7064f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:45.959780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c470427-0a06-4785-80c1-784d1f524e2d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:45.999658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f753a-81f9-4f52-a8d6-318ea2f61a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:46.000069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f753a-81f9-4f52-a8d6-318ea2f61a78 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:46.001941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f753a-81f9-4f52-a8d6-318ea2f61a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:46.002234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f753a-81f9-4f52-a8d6-318ea2f61a78 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:46.004390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f753a-81f9-4f52-a8d6-318ea2f61a78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:46.005998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f753a-81f9-4f52-a8d6-318ea2f61a78 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:46.036140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 19/37] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:46.037420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c304216-a5e7-43b1-951e-5e6f9b36178d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:46.037704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c304216-a5e7-43b1-951e-5e6f9b36178d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:46.037976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c304216-a5e7-43b1-951e-5e6f9b36178d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:46.041133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 20/38] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:46.041133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c304216-a5e7-43b1-951e-5e6f9b36178d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:46.094984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:46.107407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 10:57:45 2022] POST /identity/v3/projects => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:57:46.107407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daf8b8-fb2a-43bc-acf3-6e802a56ae61 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:46.107407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daf8b8-fb2a-43bc-acf3-6e802a56ae61 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:46.107407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daf8b8-fb2a-43bc-acf3-6e802a56ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:46.130913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-52daf8b8-fb2a-43bc-acf3-6e802a56ae61 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:46.132837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-52daf8b8-fb2a-43bc-acf3-6e802a56ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:46.185997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c304216-a5e7-43b1-951e-5e6f9b36178d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:46.225043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:46.229672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c6ce-3519-4ae7-b57c-d8bd95481721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:46.230328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c6ce-3519-4ae7-b57c-d8bd95481721 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:46.230611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c6ce-3519-4ae7-b57c-d8bd95481721 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:46.230886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c6ce-3519-4ae7-b57c-d8bd95481721 None admin] PATH_INFO: `/v3/users/4130eba1ceda435c8baed39723df5c8e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:46.232159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c6ce-3519-4ae7-b57c-d8bd95481721 None admin] RBAC: Authorizing `identity:get_user(user_id=4130eba1ceda435c8baed39723df5c8e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:46.238682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 20/40] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:46.238812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c6ce-3519-4ae7-b57c-d8bd95481721 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:46.240271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 21/41] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:57:46 2022] GET /identity/v3/users/4130eba1ceda435c8baed39723df5c8e => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:46.251721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daf8b8-fb2a-43bc-acf3-6e802a56ae61 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:46.315213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c6ce-3519-4ae7-b57c-d8bd95481721 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:46.391725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daf8b8-fb2a-43bc-acf3-6e802a56ae61 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:46.432969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7be73-1c26-4360-a044-afcf020ffc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:46.433613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7be73-1c26-4360-a044-afcf020ffc16 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:46.433892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7be73-1c26-4360-a044-afcf020ffc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:46.434166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7be73-1c26-4360-a044-afcf020ffc16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:46.435294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7be73-1c26-4360-a044-afcf020ffc16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:46.436845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7be73-1c26-4360-a044-afcf020ffc16 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:46.438368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 21/42] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:57:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:46.444699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7be73-1c26-4360-a044-afcf020ffc16 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:46.452698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c6ce-3519-4ae7-b57c-d8bd95481721 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:46.474503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:46.504750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a035daa-6305-4f38-9e39-c27dc45c9da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:46.505770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a035daa-6305-4f38-9e39-c27dc45c9da9 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:46.506402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a035daa-6305-4f38-9e39-c27dc45c9da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:46.506681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a035daa-6305-4f38-9e39-c27dc45c9da9 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:46.507896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a035daa-6305-4f38-9e39-c27dc45c9da9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:46.509285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a035daa-6305-4f38-9e39-c27dc45c9da9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:46.528906 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:46.563041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7be73-1c26-4360-a044-afcf020ffc16 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:46.587093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 22/43] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Aug 31 10:57:46 2022] POST /identity/v3/roles => generated 223 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:57:46.588243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a035daa-6305-4f38-9e39-c27dc45c9da9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:46.602581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c15324-4a41-419c-8179-ea6bc3a2ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:46.603307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c15324-4a41-419c-8179-ea6bc3a2ea33 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:46.603585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c15324-4a41-419c-8179-ea6bc3a2ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:46.603891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c15324-4a41-419c-8179-ea6bc3a2ea33 None admin] PATH_INFO: `/v3/domains/default/users/4130eba1ceda435c8baed39723df5c8e/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:46.606389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c15324-4a41-419c-8179-ea6bc3a2ea33 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4130eba1ceda435c8baed39723df5c8e, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:46.607989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c15324-4a41-419c-8179-ea6bc3a2ea33 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:46.719857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a035daa-6305-4f38-9e39-c27dc45c9da9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:46.757538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5dad5-cb41-407a-a0e9-dceab8f6226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:46.758190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5dad5-cb41-407a-a0e9-dceab8f6226a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:46.758476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5dad5-cb41-407a-a0e9-dceab8f6226a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:46.758753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5dad5-cb41-407a-a0e9-dceab8f6226a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:46.759958 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5dad5-cb41-407a-a0e9-dceab8f6226a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:46.761431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5dad5-cb41-407a-a0e9-dceab8f6226a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:46.763215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 23/44] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:57:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:46.769041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5dad5-cb41-407a-a0e9-dceab8f6226a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:46.820801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 22/45] 10.222.0.13 () {58 vars in 1361 bytes} [Wed Aug 31 10:57:46 2022] PUT /identity/v3/domains/default/users/4130eba1ceda435c8baed39723df5c8e/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:57:46.930936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:46.997105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5dad5-cb41-407a-a0e9-dceab8f6226a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:47.047517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5052d-a323-4f2f-a170-fc620a3d9ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:47.048159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5052d-a323-4f2f-a170-fc620a3d9ca5 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:47.048438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5052d-a323-4f2f-a170-fc620a3d9ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:47.048712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5052d-a323-4f2f-a170-fc620a3d9ca5 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:47.049923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5052d-a323-4f2f-a170-fc620a3d9ca5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:47.051373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5052d-a323-4f2f-a170-fc620a3d9ca5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:47.131819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 10:57:46 2022] POST /identity/v3/projects => generated 312 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:57:48.777039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f1cb-e8f7-4381-a4c6-3ef7a0742076 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.777559 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f1cb-e8f7-4381-a4c6-3ef7a0742076 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.777672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346f1cb-e8f7-4381-a4c6-3ef7a0742076 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.778963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 23/47] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:48.784355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fda6c-d780-4c65-9962-e78b77ba5255 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.784786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fda6c-d780-4c65-9962-e78b77ba5255 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.784914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fda6c-d780-4c65-9962-e78b77ba5255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.803906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ae7fda6c-d780-4c65-9962-e78b77ba5255 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:48.805128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae7fda6c-d780-4c65-9962-e78b77ba5255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:48.885011 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:49.092361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce5fb-dca8-430e-81be-a75b4f18d85e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.092659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce5fb-dca8-430e-81be-a75b4f18d85e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.092929 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce5fb-dca8-430e-81be-a75b4f18d85e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.094281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 24/49] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:49.100300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836378e7-4a97-4bd8-8026-4462bb9abcb9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.100590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836378e7-4a97-4bd8-8026-4462bb9abcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.100873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836378e7-4a97-4bd8-8026-4462bb9abcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.119953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-836378e7-4a97-4bd8-8026-4462bb9abcb9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:49.121170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-836378e7-4a97-4bd8-8026-4462bb9abcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:49.139353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:49.155335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce5fb-dca8-430e-81be-a75b4f18d85e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:49.197266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 26/50] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:49.269304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce5fb-dca8-430e-81be-a75b4f18d85e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:49.298442 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:49.307110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789d864-3cc7-43f9-9340-6fd430ddb3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.307766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789d864-3cc7-43f9-9340-6fd430ddb3db None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.310917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789d864-3cc7-43f9-9340-6fd430ddb3db None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.310917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789d864-3cc7-43f9-9340-6fd430ddb3db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.320326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789d864-3cc7-43f9-9340-6fd430ddb3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8789d864-3cc7-43f9-9340-6fd430ddb3db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:57:49.326433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:57:49.327327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:57:49.328327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 25/51] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:57:49.338512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836378e7-4a97-4bd8-8026-4462bb9abcb9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:49.437923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836378e7-4a97-4bd8-8026-4462bb9abcb9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:49.468800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789d864-3cc7-43f9-9340-6fd430ddb3db None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:49.475800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdfddd-694e-4c77-b585-71f200cd9a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.476611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdfddd-694e-4c77-b585-71f200cd9a10 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.477018 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdfddd-694e-4c77-b585-71f200cd9a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.477296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdfddd-694e-4c77-b585-71f200cd9a10 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.477982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdfddd-694e-4c77-b585-71f200cd9a10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:49.478288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdfddd-694e-4c77-b585-71f200cd9a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:49.479699 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdfddd-694e-4c77-b585-71f200cd9a10 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:49.489324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 27/52] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:49.505685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdfddd-694e-4c77-b585-71f200cd9a10 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:49.525146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:49.598236 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789d864-3cc7-43f9-9340-6fd430ddb3db None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:49.626723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdfddd-694e-4c77-b585-71f200cd9a10 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:49.634641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132319-c5be-44b9-8f48-b75db29a994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.635287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132319-c5be-44b9-8f48-b75db29a994c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.635565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132319-c5be-44b9-8f48-b75db29a994c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.635887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132319-c5be-44b9-8f48-b75db29a994c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.637013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132319-c5be-44b9-8f48-b75db29a994c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:49.638486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132319-c5be-44b9-8f48-b75db29a994c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:49.640179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:57:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:49.646313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132319-c5be-44b9-8f48-b75db29a994c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:49.668257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c2f4b-899f-4fdf-a682-bdf90f13c3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.668895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2f4b-899f-4fdf-a682-bdf90f13c3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.669172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2f4b-899f-4fdf-a682-bdf90f13c3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.671460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c2f4b-899f-4fdf-a682-bdf90f13c3e3 None admin] PATH_INFO: `/v3/users/4130eba1ceda435c8baed39723df5c8e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.671460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c2f4b-899f-4fdf-a682-bdf90f13c3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=4130eba1ceda435c8baed39723df5c8e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:49.672130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c2f4b-899f-4fdf-a682-bdf90f13c3e3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:49.673917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 28/54] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:57:49 2022] GET /identity/v3/users/4130eba1ceda435c8baed39723df5c8e => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:49.680414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c2f4b-899f-4fdf-a682-bdf90f13c3e3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:49.705208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:49.755610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132319-c5be-44b9-8f48-b75db29a994c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:49.782877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:49.792403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dbf5e-cb67-4ad1-9530-1327041f7540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.793092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dbf5e-cb67-4ad1-9530-1327041f7540 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.793290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dbf5e-cb67-4ad1-9530-1327041f7540 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.793564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dbf5e-cb67-4ad1-9530-1327041f7540 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.794230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dbf5e-cb67-4ad1-9530-1327041f7540 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:49.795683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dbf5e-cb67-4ad1-9530-1327041f7540 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:49.798400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c2f4b-899f-4fdf-a682-bdf90f13c3e3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:49.841529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04425d34-4a44-432a-8ace-9fb7b0c644fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.842175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04425d34-4a44-432a-8ace-9fb7b0c644fd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.842455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04425d34-4a44-432a-8ace-9fb7b0c644fd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.842732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04425d34-4a44-432a-8ace-9fb7b0c644fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.843902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04425d34-4a44-432a-8ace-9fb7b0c644fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:49.845366 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04425d34-4a44-432a-8ace-9fb7b0c644fd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:49.847230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 29/55] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:57:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:49.853153 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04425d34-4a44-432a-8ace-9fb7b0c644fd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:49.952900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04425d34-4a44-432a-8ace-9fb7b0c644fd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:49.965157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 27/56] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Aug 31 10:57:49 2022] POST /identity/v3/projects => generated 298 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:57:49.994248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5b626-1902-4905-9ee3-ce26c6183262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.994896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5b626-1902-4905-9ee3-ce26c6183262 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.995176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5b626-1902-4905-9ee3-ce26c6183262 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.995448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5b626-1902-4905-9ee3-ce26c6183262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.997059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5b626-1902-4905-9ee3-ce26c6183262 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.domain.id=default, user.id=4130eba1ceda435c8baed39723df5c8e) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:49.997757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5b626-1902-4905-9ee3-ce26c6183262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:50.001346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5b626-1902-4905-9ee3-ce26c6183262 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:50.010392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 30/57] 10.222.0.13 () {56 vars in 1322 bytes} [Wed Aug 31 10:57:49 2022] GET /identity/v3/role_assignments?user.id=4130eba1ceda435c8baed39723df5c8e&scope.domain.id=default&role.id=55aed406476a485f99f9815f9f27cb3b => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:57:51.955766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9070-e811-42ac-b7c1-d17b5abaed87 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:51.956328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9070-e811-42ac-b7c1-d17b5abaed87 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:51.956415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9070-e811-42ac-b7c1-d17b5abaed87 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:51.957775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 28/58] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:51.963350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac5614-6ee0-4155-a204-3f6b8afdebb0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:51.963855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac5614-6ee0-4155-a204-3f6b8afdebb0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:51.963962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac5614-6ee0-4155-a204-3f6b8afdebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:51.983323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ceac5614-6ee0-4155-a204-3f6b8afdebb0 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:51.984568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ceac5614-6ee0-4155-a204-3f6b8afdebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:51.996902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:52.056592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 31/59] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:52.339118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb9070-e811-42ac-b7c1-d17b5abaed87 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:52.560392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb9070-e811-42ac-b7c1-d17b5abaed87 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:52.571853 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:52.596709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601abbe5-5d5d-4117-8062-fe7a652bb5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:52.597531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abbe5-5d5d-4117-8062-fe7a652bb5ef None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:52.597817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abbe5-5d5d-4117-8062-fe7a652bb5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:52.598092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abbe5-5d5d-4117-8062-fe7a652bb5ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:52.599242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601abbe5-5d5d-4117-8062-fe7a652bb5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:52.600747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601abbe5-5d5d-4117-8062-fe7a652bb5ef None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:52.602344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 29/60] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:57:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:52.607967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac5614-6ee0-4155-a204-3f6b8afdebb0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:52.716001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac5614-6ee0-4155-a204-3f6b8afdebb0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:52.752455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170736-66b8-4b07-8a4f-a3b3e78508ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:52.753231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170736-66b8-4b07-8a4f-a3b3e78508ca None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:52.753513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170736-66b8-4b07-8a4f-a3b3e78508ca None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:52.753789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170736-66b8-4b07-8a4f-a3b3e78508ca None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:52.754457 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170736-66b8-4b07-8a4f-a3b3e78508ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:52.755961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170736-66b8-4b07-8a4f-a3b3e78508ca None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:53.038175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 32/61] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:57:52 2022] POST /identity/v3/users => generated 275 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:57:56.392258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecef2f-a9c7-474a-a504-87f5941232f8 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:56.392765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecef2f-a9c7-474a-a504-87f5941232f8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:56.392836 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecef2f-a9c7-474a-a504-87f5941232f8 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:56.395165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 30/62] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:56.403872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03472c16-20d4-4732-9ff1-76d48e552536 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:56.403872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03472c16-20d4-4732-9ff1-76d48e552536 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:56.403872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03472c16-20d4-4732-9ff1-76d48e552536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:56.411785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:56.428921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-03472c16-20d4-4732-9ff1-76d48e552536 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:56.431054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-03472c16-20d4-4732-9ff1-76d48e552536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:56.453119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b7e03-8727-4c8d-ba27-2c0a9da0b79c None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:56.453600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b7e03-8727-4c8d-ba27-2c0a9da0b79c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:56.453884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b7e03-8727-4c8d-ba27-2c0a9da0b79c None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:56.455228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:57:56.474366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b70b-6bb0-4f27-a249-067feb75637f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:56.474985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b70b-6bb0-4f27-a249-067feb75637f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:56.475571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b70b-6bb0-4f27-a249-067feb75637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:56.496744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9b94b70b-6bb0-4f27-a249-067feb75637f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:56.498747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9b94b70b-6bb0-4f27-a249-067feb75637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:56.554138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 33/64] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:56.608384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 32/65] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:57:56.759342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05141a-e222-4e02-bb71-4ff26a22205d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:56.759688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05141a-e222-4e02-bb71-4ff26a22205d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:56.760012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05141a-e222-4e02-bb71-4ff26a22205d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:56.761383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 34/66] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:57:56.767045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dccbf8-a7d7-423e-8c5f-acdbc2d9835f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:56.767329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dccbf8-a7d7-423e-8c5f-acdbc2d9835f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:56.767610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dccbf8-a7d7-423e-8c5f-acdbc2d9835f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:56.780737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a29adc-c252-46d6-a3d5-76dec6d8b97d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:56.781047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a29adc-c252-46d6-a3d5-76dec6d8b97d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:56.781290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a29adc-c252-46d6-a3d5-76dec6d8b97d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:56.782764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 35/67] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:57:56.789046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c410c-1dfb-4103-92da-88cbd6010914 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:56.789368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c410c-1dfb-4103-92da-88cbd6010914 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:56.789676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c410c-1dfb-4103-92da-88cbd6010914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:56.811114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-24dccbf8-a7d7-423e-8c5f-acdbc2d9835f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:56.812280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-24dccbf8-a7d7-423e-8c5f-acdbc2d9835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:56.818005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5f6c410c-1dfb-4103-92da-88cbd6010914 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:56.819515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5f6c410c-1dfb-4103-92da-88cbd6010914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:56.916054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 36/68] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:56.916567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 33/69] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:56.923767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c410c-1dfb-4103-92da-88cbd6010914 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:56.981995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dccbf8-a7d7-423e-8c5f-acdbc2d9835f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:56.985085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:57.029678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c410c-1dfb-4103-92da-88cbd6010914 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.067987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:57.068924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bbd19-ad0b-49f4-bc98-87105e6d151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.071780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bbd19-ad0b-49f4-bc98-87105e6d151e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.071780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bbd19-ad0b-49f4-bc98-87105e6d151e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.071780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bbd19-ad0b-49f4-bc98-87105e6d151e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.081351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bbd19-ad0b-49f4-bc98-87105e6d151e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3c3bbd19-ad0b-49f4-bc98-87105e6d151e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:57:57.086327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:57:57.088940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:57:57.089688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 37/70] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:57:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:57:57.094281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1e987-86db-4acf-8d82-7a621e5dd539 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.094573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1e987-86db-4acf-8d82-7a621e5dd539 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.095015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1e987-86db-4acf-8d82-7a621e5dd539 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.097231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 38/71] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:57:57.097756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1e987-86db-4acf-8d82-7a621e5dd539 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:57.168587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dccbf8-a7d7-423e-8c5f-acdbc2d9835f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.210831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bb846-3439-4ea9-ba40-5455fd747abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.211486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb846-3439-4ea9-ba40-5455fd747abe None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.211812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb846-3439-4ea9-ba40-5455fd747abe None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.212080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb846-3439-4ea9-ba40-5455fd747abe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.224649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bb846-3439-4ea9-ba40-5455fd747abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-ae5bb846-3439-4ea9-ba40-5455fd747abe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:57:57.230405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:57:57.231274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:57:57.232450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 34/72] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:57:57.238291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c766a9-8362-455b-a467-372ee9e14b96 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.238617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c766a9-8362-455b-a467-372ee9e14b96 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.238961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c766a9-8362-455b-a467-372ee9e14b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.251244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1e987-86db-4acf-8d82-7a621e5dd539 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.259382 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-11c766a9-8362-455b-a467-372ee9e14b96 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:57.260604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-11c766a9-8362-455b-a467-372ee9e14b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:57.280306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:57.292750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386dcfe5-177d-427e-a0ce-1d5852414bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.298842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dcfe5-177d-427e-a0ce-1d5852414bcb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.298842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dcfe5-177d-427e-a0ce-1d5852414bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.298842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dcfe5-177d-427e-a0ce-1d5852414bcb None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.298842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386dcfe5-177d-427e-a0ce-1d5852414bcb None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:57.298842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386dcfe5-177d-427e-a0ce-1d5852414bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:57.298842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386dcfe5-177d-427e-a0ce-1d5852414bcb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:57.309661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 39/73] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:57.309661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386dcfe5-177d-427e-a0ce-1d5852414bcb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:57.344869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 35/74] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:57.345684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c766a9-8362-455b-a467-372ee9e14b96 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:57.376559 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:57.429072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386dcfe5-177d-427e-a0ce-1d5852414bcb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.466397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c766a9-8362-455b-a467-372ee9e14b96 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.468790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a3253-5883-41c2-a2ff-fdc80326b43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.469411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3253-5883-41c2-a2ff-fdc80326b43c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.469692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3253-5883-41c2-a2ff-fdc80326b43c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.469967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3253-5883-41c2-a2ff-fdc80326b43c None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.470632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a3253-5883-41c2-a2ff-fdc80326b43c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:57.470939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a3253-5883-41c2-a2ff-fdc80326b43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:57.473405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a3253-5883-41c2-a2ff-fdc80326b43c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:57.488025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 40/75] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:57.488025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a3253-5883-41c2-a2ff-fdc80326b43c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:57.511356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaf3ca-34f3-4ba1-9fe6-0a3fe59df398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.512025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaf3ca-34f3-4ba1-9fe6-0a3fe59df398 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.512310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaf3ca-34f3-4ba1-9fe6-0a3fe59df398 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.512583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaf3ca-34f3-4ba1-9fe6-0a3fe59df398 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.523712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaf3ca-34f3-4ba1-9fe6-0a3fe59df398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-acdaf3ca-34f3-4ba1-9fe6-0a3fe59df398 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:57:57.528534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:57:57.530013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 36/76] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:57:57.531579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaf3ca-34f3-4ba1-9fe6-0a3fe59df398 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:57.550066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:57.605651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a3253-5883-41c2-a2ff-fdc80326b43c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.647005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:57.651848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea8126-d00d-4fc6-9202-b9933af2b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.652493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea8126-d00d-4fc6-9202-b9933af2b394 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.652772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea8126-d00d-4fc6-9202-b9933af2b394 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.653047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea8126-d00d-4fc6-9202-b9933af2b394 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.663191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaf3ca-34f3-4ba1-9fe6-0a3fe59df398 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.664176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea8126-d00d-4fc6-9202-b9933af2b394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-42ea8126-d00d-4fc6-9202-b9933af2b394 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:57:57.669640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:57:57.670484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:57:57.671478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 41/77] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:57:57.672704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea8126-d00d-4fc6-9202-b9933af2b394 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:57.700319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89573914-58eb-44c0-a608-b9470fd3e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.701219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573914-58eb-44c0-a608-b9470fd3e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.701588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573914-58eb-44c0-a608-b9470fd3e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.701990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89573914-58eb-44c0-a608-b9470fd3e0d8 None admin] PATH_INFO: `/v3/users/732cad40509a4bc799b9ef3a107f5645` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.718178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89573914-58eb-44c0-a608-b9470fd3e0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=732cad40509a4bc799b9ef3a107f5645)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:57.719650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89573914-58eb-44c0-a608-b9470fd3e0d8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:57.722269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 37/78] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/users/732cad40509a4bc799b9ef3a107f5645 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:57.722885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89573914-58eb-44c0-a608-b9470fd3e0d8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:57.796754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea8126-d00d-4fc6-9202-b9933af2b394 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.805969 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:57.835647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89573914-58eb-44c0-a608-b9470fd3e0d8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.837029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810491-04e0-4deb-8bd9-87a80d906763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.837678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810491-04e0-4deb-8bd9-87a80d906763 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.837967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810491-04e0-4deb-8bd9-87a80d906763 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.838269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810491-04e0-4deb-8bd9-87a80d906763 None admin] PATH_INFO: `/v3/users/4130eba1ceda435c8baed39723df5c8e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.839381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810491-04e0-4deb-8bd9-87a80d906763 None admin] RBAC: Authorizing `identity:get_user(user_id=4130eba1ceda435c8baed39723df5c8e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:57.840887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810491-04e0-4deb-8bd9-87a80d906763 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:57.842483 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 42/79] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/users/4130eba1ceda435c8baed39723df5c8e => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:57.843257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810491-04e0-4deb-8bd9-87a80d906763 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:57.873289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542f3db-0572-4b4d-a33b-99b8739bee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.873873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542f3db-0572-4b4d-a33b-99b8739bee5d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.874182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542f3db-0572-4b4d-a33b-99b8739bee5d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.874487 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542f3db-0572-4b4d-a33b-99b8739bee5d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.875117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542f3db-0572-4b4d-a33b-99b8739bee5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:57.875448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542f3db-0572-4b4d-a33b-99b8739bee5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:57.876869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542f3db-0572-4b4d-a33b-99b8739bee5d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:57.890085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 38/80] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:57.890677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542f3db-0572-4b4d-a33b-99b8739bee5d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:57.903755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:57.952176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810491-04e0-4deb-8bd9-87a80d906763 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:57.988890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780a3f-3cf9-4819-9498-f160e44331ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:57.989583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780a3f-3cf9-4819-9498-f160e44331ea None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:57.989855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780a3f-3cf9-4819-9498-f160e44331ea None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:57.990133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780a3f-3cf9-4819-9498-f160e44331ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:57.991296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca780a3f-3cf9-4819-9498-f160e44331ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:57.992787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca780a3f-3cf9-4819-9498-f160e44331ea None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:57.994365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 43/81] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:57.995317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780a3f-3cf9-4819-9498-f160e44331ea None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:58.013146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542f3db-0572-4b4d-a33b-99b8739bee5d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:58.049378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec474e-472e-4eba-8cdb-0c4be7f0b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:58.050280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec474e-472e-4eba-8cdb-0c4be7f0b26f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:58.050567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec474e-472e-4eba-8cdb-0c4be7f0b26f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:58.050844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec474e-472e-4eba-8cdb-0c4be7f0b26f None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:58.050938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:58.051604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec474e-472e-4eba-8cdb-0c4be7f0b26f None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:58.051862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec474e-472e-4eba-8cdb-0c4be7f0b26f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:58.053595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec474e-472e-4eba-8cdb-0c4be7f0b26f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:58.062619 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 39/82] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:58.063583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec474e-472e-4eba-8cdb-0c4be7f0b26f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:58.112518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780a3f-3cf9-4819-9498-f160e44331ea None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:58.141309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:58.148538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe73254-e699-4b96-80ea-4bdba6fe83d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:58.149154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe73254-e699-4b96-80ea-4bdba6fe83d3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:58.158762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe73254-e699-4b96-80ea-4bdba6fe83d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:58.158762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe73254-e699-4b96-80ea-4bdba6fe83d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:58.179631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec474e-472e-4eba-8cdb-0c4be7f0b26f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:58.220708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1c4ec-aaa5-4b21-b776-974c54da02d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:58.221440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c4ec-aaa5-4b21-b776-974c54da02d2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:58.221725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c4ec-aaa5-4b21-b776-974c54da02d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:58.221989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c4ec-aaa5-4b21-b776-974c54da02d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:58.222978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe73254-e699-4b96-80ea-4bdba6fe83d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:58.230901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe73254-e699-4b96-80ea-4bdba6fe83d3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:58.269324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:58.305751 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1c4ec-aaa5-4b21-b776-974c54da02d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:58.307228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1c4ec-aaa5-4b21-b776-974c54da02d2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:58.338226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 44/83] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:58.339082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe73254-e699-4b96-80ea-4bdba6fe83d3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:58.378420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:58.412617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 40/84] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:58.413380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1c4ec-aaa5-4b21-b776-974c54da02d2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:58.441625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe73254-e699-4b96-80ea-4bdba6fe83d3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:58.476556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3abb6-ad6f-4e6a-ae3b-da06bb2335ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:58.477187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3abb6-ad6f-4e6a-ae3b-da06bb2335ab None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:58.477472 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3abb6-ad6f-4e6a-ae3b-da06bb2335ab None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:58.477731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3abb6-ad6f-4e6a-ae3b-da06bb2335ab None admin] PATH_INFO: `/v3/users/732cad40509a4bc799b9ef3a107f5645` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:58.478869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3abb6-ad6f-4e6a-ae3b-da06bb2335ab None admin] RBAC: Authorizing `identity:get_user(user_id=732cad40509a4bc799b9ef3a107f5645)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:58.480363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3abb6-ad6f-4e6a-ae3b-da06bb2335ab None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:58.481954 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 45/85] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:57:58 2022] GET /identity/v3/users/732cad40509a4bc799b9ef3a107f5645 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:58.482714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3abb6-ad6f-4e6a-ae3b-da06bb2335ab None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:58.498152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:58.531527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1c4ec-aaa5-4b21-b776-974c54da02d2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:58.569513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ebebe-f280-4649-a292-7a376099a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:58.570118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ebebe-f280-4649-a292-7a376099a8b9 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:58.570390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ebebe-f280-4649-a292-7a376099a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:58.570659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ebebe-f280-4649-a292-7a376099a8b9 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:58.571423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ebebe-f280-4649-a292-7a376099a8b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:58.572909 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ebebe-f280-4649-a292-7a376099a8b9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:58.589891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3abb6-ad6f-4e6a-ae3b-da06bb2335ab None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:58.627886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a457ac-1cbd-442e-9d0a-61618bfe2e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:58.628568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a457ac-1cbd-442e-9d0a-61618bfe2e04 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:58.628849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a457ac-1cbd-442e-9d0a-61618bfe2e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:58.629123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a457ac-1cbd-442e-9d0a-61618bfe2e04 None admin] PATH_INFO: `/v3/users/732cad40509a4bc799b9ef3a107f5645` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:58.630259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a457ac-1cbd-442e-9d0a-61618bfe2e04 None admin] RBAC: Authorizing `identity:get_user(user_id=732cad40509a4bc799b9ef3a107f5645)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:58.631807 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a457ac-1cbd-442e-9d0a-61618bfe2e04 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:58.633414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 46/86] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:57:58 2022] GET /identity/v3/users/732cad40509a4bc799b9ef3a107f5645 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:58.634179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a457ac-1cbd-442e-9d0a-61618bfe2e04 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:58.717333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 41/87] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:57:58 2022] POST /identity/v3/users => generated 289 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:57:58.718227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ebebe-f280-4649-a292-7a376099a8b9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:58.718355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:58.749477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:58.752606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a457ac-1cbd-442e-9d0a-61618bfe2e04 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:58.804872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fb817-608a-4c3a-9e5c-480cb0deb45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:58.805522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fb817-608a-4c3a-9e5c-480cb0deb45b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:58.805818 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fb817-608a-4c3a-9e5c-480cb0deb45b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:58.806067 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fb817-608a-4c3a-9e5c-480cb0deb45b None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:58.807567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fb817-608a-4c3a-9e5c-480cb0deb45b None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:58.809103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fb817-608a-4c3a-9e5c-480cb0deb45b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:58.810833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 47/88] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:57:58 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:58.811632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fb817-608a-4c3a-9e5c-480cb0deb45b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:58.843504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ebebe-f280-4649-a292-7a376099a8b9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:58.889160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69205bc2-419a-418b-a9ad-9905dead4405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:58.889810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69205bc2-419a-418b-a9ad-9905dead4405 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:58.890097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69205bc2-419a-418b-a9ad-9905dead4405 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:58.890374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69205bc2-419a-418b-a9ad-9905dead4405 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:58.891561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69205bc2-419a-418b-a9ad-9905dead4405 None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:58.893128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69205bc2-419a-418b-a9ad-9905dead4405 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:58.894836 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 42/89] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:57:58 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:58.901349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69205bc2-419a-418b-a9ad-9905dead4405 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:58.948605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fb817-608a-4c3a-9e5c-480cb0deb45b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:58.999344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94055034-159d-43df-8bc4-3c179be1259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:59.000391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94055034-159d-43df-8bc4-3c179be1259b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:59.000841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94055034-159d-43df-8bc4-3c179be1259b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:59.001306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94055034-159d-43df-8bc4-3c179be1259b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:59.022234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:59.022416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:59.032067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69205bc2-419a-418b-a9ad-9905dead4405 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:59.094932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8653517-bbf7-4f24-96a7-a589974a30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:59.096925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653517-bbf7-4f24-96a7-a589974a30e4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:59.097423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653517-bbf7-4f24-96a7-a589974a30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:59.098066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8653517-bbf7-4f24-96a7-a589974a30e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:59.111733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94055034-159d-43df-8bc4-3c179be1259b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:59.114106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94055034-159d-43df-8bc4-3c179be1259b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:59.211660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8653517-bbf7-4f24-96a7-a589974a30e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:59.214241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8653517-bbf7-4f24-96a7-a589974a30e4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:59.265079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 48/90] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:59.270826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94055034-159d-43df-8bc4-3c179be1259b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:59.335616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:59.351048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:59.364468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 43/91] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:59.365731 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8653517-bbf7-4f24-96a7-a589974a30e4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:59.405474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94055034-159d-43df-8bc4-3c179be1259b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:59.458995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc6be-fcb2-40ae-adb0-ca2436509586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:59.459719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc6be-fcb2-40ae-adb0-ca2436509586 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:59.460105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc6be-fcb2-40ae-adb0-ca2436509586 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:59.460490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc6be-fcb2-40ae-adb0-ca2436509586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:59.461663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bc6be-fcb2-40ae-adb0-ca2436509586 None admin] RBAC: Adding query filter params (role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc, user.id=732cad40509a4bc799b9ef3a107f5645) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:59.462061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bc6be-fcb2-40ae-adb0-ca2436509586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:59.464359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bc6be-fcb2-40ae-adb0-ca2436509586 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:59.473007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 49/92] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:57:59 2022] GET /identity/v3/role_assignments?user.id=732cad40509a4bc799b9ef3a107f5645&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:59.473979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc6be-fcb2-40ae-adb0-ca2436509586 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:59.511038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8653517-bbf7-4f24-96a7-a589974a30e4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:59.560625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b27f0-f70a-4907-8c94-c17ed88230b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:59.562161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b27f0-f70a-4907-8c94-c17ed88230b9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:59.562587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b27f0-f70a-4907-8c94-c17ed88230b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:59.563029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b27f0-f70a-4907-8c94-c17ed88230b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:59.564058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b27f0-f70a-4907-8c94-c17ed88230b9 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc, user.id=4130eba1ceda435c8baed39723df5c8e) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:57:59.564592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b27f0-f70a-4907-8c94-c17ed88230b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:59.566544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b27f0-f70a-4907-8c94-c17ed88230b9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:59.590221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 44/93] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:57:59 2022] GET /identity/v3/role_assignments?user.id=4130eba1ceda435c8baed39723df5c8e&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=55aed406476a485f99f9815f9f27cb3b => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:59.591541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b27f0-f70a-4907-8c94-c17ed88230b9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:59.668418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc6be-fcb2-40ae-adb0-ca2436509586 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:59.700988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:59.769489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:59.778517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d080b4-688e-4d31-837e-7a400b16dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:59.779787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d080b4-688e-4d31-837e-7a400b16dece None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:59.780085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d080b4-688e-4d31-837e-7a400b16dece None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:59.780367 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d080b4-688e-4d31-837e-7a400b16dece None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:59.781894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d080b4-688e-4d31-837e-7a400b16dece None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:59.784592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d080b4-688e-4d31-837e-7a400b16dece None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:59.788011 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 50/94] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:57:59 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:59.793953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d080b4-688e-4d31-837e-7a400b16dece None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:59.828228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b27f0-f70a-4907-8c94-c17ed88230b9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:59.905167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95812c-ef51-416e-bdbe-ed9ef17728e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:59.905824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95812c-ef51-416e-bdbe-ed9ef17728e6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:59.906110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95812c-ef51-416e-bdbe-ed9ef17728e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:59.906388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95812c-ef51-416e-bdbe-ed9ef17728e6 None admin] PATH_INFO: `/v3/projects/f23dc36a79354b458faadbe1a6e3b118` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:59.907768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95812c-ef51-416e-bdbe-ed9ef17728e6 None admin] RBAC: Authorizing `identity:get_project(project_id=f23dc36a79354b458faadbe1a6e3b118)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:59.909717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95812c-ef51-416e-bdbe-ed9ef17728e6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:59.915933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 45/95] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:57:59 2022] GET /identity/v3/projects/f23dc36a79354b458faadbe1a6e3b118 => generated 312 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:57:59.918040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95812c-ef51-416e-bdbe-ed9ef17728e6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:00.006042 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d080b4-688e-4d31-837e-7a400b16dece None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:00.105321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05904c-1ab4-4822-83b1-5040ccdb368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:00.106304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05904c-1ab4-4822-83b1-5040ccdb368a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:00.106785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05904c-1ab4-4822-83b1-5040ccdb368a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:00.107256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05904c-1ab4-4822-83b1-5040ccdb368a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:00.108228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05904c-1ab4-4822-83b1-5040ccdb368a None admin] RBAC: Adding query filter params (role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc, user.id=732cad40509a4bc799b9ef3a107f5645) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:00.108752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05904c-1ab4-4822-83b1-5040ccdb368a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:00.110417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05904c-1ab4-4822-83b1-5040ccdb368a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:00.111372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95812c-ef51-416e-bdbe-ed9ef17728e6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:00.129800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 51/96] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:57:59 2022] GET /identity/v3/role_assignments?user.id=732cad40509a4bc799b9ef3a107f5645&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:00.140590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:00.153603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9c8ab-37fb-4fb5-b269-3826d910df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:00.154373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9c8ab-37fb-4fb5-b269-3826d910df8e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:00.154663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9c8ab-37fb-4fb5-b269-3826d910df8e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:00.154997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9c8ab-37fb-4fb5-b269-3826d910df8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:00.155795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9c8ab-37fb-4fb5-b269-3826d910df8e None admin] RBAC: Adding query filter params (role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=f23dc36a79354b458faadbe1a6e3b118, user.id=732cad40509a4bc799b9ef3a107f5645) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:00.156121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9c8ab-37fb-4fb5-b269-3826d910df8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:00.157656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9c8ab-37fb-4fb5-b269-3826d910df8e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:00.165655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 46/97] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:57:59 2022] GET /identity/v3/role_assignments?user.id=732cad40509a4bc799b9ef3a107f5645&scope.project.id=f23dc36a79354b458faadbe1a6e3b118&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:01.450538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4796-d267-45fa-9705-7a2ad74b1947 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:01.451648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4796-d267-45fa-9705-7a2ad74b1947 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:01.452158 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4796-d267-45fa-9705-7a2ad74b1947 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:01.453841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 52/98] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:01.459879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22147-bfaa-40e6-bb79-fcd244b4a4d7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:01.460818 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22147-bfaa-40e6-bb79-fcd244b4a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:01.461313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22147-bfaa-40e6-bb79-fcd244b4a4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:01.488781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-00e22147-bfaa-40e6-bb79-fcd244b4a4d7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:01.490350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-00e22147-bfaa-40e6-bb79-fcd244b4a4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:01.550512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4ec3-6a4c-421f-aaab-48d3f73284a6 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:01.551102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4ec3-6a4c-421f-aaab-48d3f73284a6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:01.551685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c4ec3-6a4c-421f-aaab-48d3f73284a6 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:01.553635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 53/99] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:58:01.560326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9e8b-e7ad-4d2e-898d-1377220cb21e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:01.560877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9e8b-e7ad-4d2e-898d-1377220cb21e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:01.561339 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9e8b-e7ad-4d2e-898d-1377220cb21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:01.587086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-50ed9e8b-e7ad-4d2e-898d-1377220cb21e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:01.589933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-50ed9e8b-e7ad-4d2e-898d-1377220cb21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:01.611172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 47/100] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:01.655152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:01.724863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 54/101] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:02.104741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e22147-bfaa-40e6-bb79-fcd244b4a4d7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:02.233757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed9e8b-e7ad-4d2e-898d-1377220cb21e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:02.297152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e22147-bfaa-40e6-bb79-fcd244b4a4d7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:02.337916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:02.375541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838efe8-7a46-493f-9b39-a1381d8bab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:02.376127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838efe8-7a46-493f-9b39-a1381d8bab55 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:02.376403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838efe8-7a46-493f-9b39-a1381d8bab55 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:02.376672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838efe8-7a46-493f-9b39-a1381d8bab55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:02.378786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838efe8-7a46-493f-9b39-a1381d8bab55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:02.380998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838efe8-7a46-493f-9b39-a1381d8bab55 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:02.387104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 48/102] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:02.388712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838efe8-7a46-493f-9b39-a1381d8bab55 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:02.458240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed9e8b-e7ad-4d2e-898d-1377220cb21e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:02.523265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca53ed-47fd-40c7-8c75-978ad8a7ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:02.524303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca53ed-47fd-40c7-8c75-978ad8a7ca7c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:02.524801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca53ed-47fd-40c7-8c75-978ad8a7ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:02.525270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca53ed-47fd-40c7-8c75-978ad8a7ca7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:02.544736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca53ed-47fd-40c7-8c75-978ad8a7ca7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b7ca53ed-47fd-40c7-8c75-978ad8a7ca7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:02.555589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:02.556523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:02.557266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:02.561973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 55/103] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:02.571900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca53ed-47fd-40c7-8c75-978ad8a7ca7c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:02.579590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838efe8-7a46-493f-9b39-a1381d8bab55 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:02.626988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:02.656686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eca37c-7b6a-40d1-9524-9463fa871355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:02.657308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eca37c-7b6a-40d1-9524-9463fa871355 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:02.657611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eca37c-7b6a-40d1-9524-9463fa871355 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:02.657883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eca37c-7b6a-40d1-9524-9463fa871355 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:02.659173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eca37c-7b6a-40d1-9524-9463fa871355 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:02.661096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eca37c-7b6a-40d1-9524-9463fa871355 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:02.743055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca53ed-47fd-40c7-8c75-978ad8a7ca7c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:02.782812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ec1a-7fa0-48fa-92e1-2ee5e8a2ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:02.784101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ec1a-7fa0-48fa-92e1-2ee5e8a2ae66 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:02.784514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ec1a-7fa0-48fa-92e1-2ee5e8a2ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:02.784924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ec1a-7fa0-48fa-92e1-2ee5e8a2ae66 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:02.785604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7ec1a-7fa0-48fa-92e1-2ee5e8a2ae66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:02.785908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7ec1a-7fa0-48fa-92e1-2ee5e8a2ae66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:02.788254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7ec1a-7fa0-48fa-92e1-2ee5e8a2ae66 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:02.797617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 56/104] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:02.803840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ec1a-7fa0-48fa-92e1-2ee5e8a2ae66 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:02.833838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 49/105] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 10:58:02 2022] POST /identity/v3/projects => generated 302 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:02.959922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:02.968013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ec1a-7fa0-48fa-92e1-2ee5e8a2ae66 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:02.975160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46513c3-6146-4984-b70f-2141ca7675eb None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:02.975467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46513c3-6146-4984-b70f-2141ca7675eb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:02.975714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46513c3-6146-4984-b70f-2141ca7675eb None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:02.979440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 50/106] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:02.983168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d48c9-f5a9-4f46-9e2f-6ad22ff4682b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:02.983523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d48c9-f5a9-4f46-9e2f-6ad22ff4682b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:02.983898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d48c9-f5a9-4f46-9e2f-6ad22ff4682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.024925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-336d48c9-f5a9-4f46-9e2f-6ad22ff4682b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:03.026188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-336d48c9-f5a9-4f46-9e2f-6ad22ff4682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:03.044724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12f6ce-7ca4-4a25-acde-275694b29397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:03.045398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12f6ce-7ca4-4a25-acde-275694b29397 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:03.045685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12f6ce-7ca4-4a25-acde-275694b29397 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:03.045965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12f6ce-7ca4-4a25-acde-275694b29397 None admin] PATH_INFO: `/v3/users/e2b0b629e6ab46148f89bd99cce01ad6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.069360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12f6ce-7ca4-4a25-acde-275694b29397 None admin] RBAC: Authorizing `identity:get_user(user_id=e2b0b629e6ab46148f89bd99cce01ad6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:03.071638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12f6ce-7ca4-4a25-acde-275694b29397 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:03.074230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 57/107] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:02 2022] GET /identity/v3/users/e2b0b629e6ab46148f89bd99cce01ad6 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:03.091586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12f6ce-7ca4-4a25-acde-275694b29397 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:03.095785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:03.151224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 51/108] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:03.237340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12f6ce-7ca4-4a25-acde-275694b29397 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:03.295601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feeaee-f365-4d8c-b74e-ed9f1b7ac270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:03.296540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feeaee-f365-4d8c-b74e-ed9f1b7ac270 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:03.296954 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feeaee-f365-4d8c-b74e-ed9f1b7ac270 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:03.297388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feeaee-f365-4d8c-b74e-ed9f1b7ac270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.323515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:03.374811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feeaee-f365-4d8c-b74e-ed9f1b7ac270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:03.376570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feeaee-f365-4d8c-b74e-ed9f1b7ac270 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:03.385428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a94d88-bada-4c64-9959-764a7996bd76 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:03.385861 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a94d88-bada-4c64-9959-764a7996bd76 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:03.386231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a94d88-bada-4c64-9959-764a7996bd76 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.387731 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 52/109] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:58:03.395106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ca8b-9ef5-47ed-b4c3-6debe5df7264 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:03.395526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ca8b-9ef5-47ed-b4c3-6debe5df7264 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:03.395928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ca8b-9ef5-47ed-b4c3-6debe5df7264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.418808 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1b28ca8b-9ef5-47ed-b4c3-6debe5df7264 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:03.420305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1b28ca8b-9ef5-47ed-b4c3-6debe5df7264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:03.495836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 58/110] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:03.504482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feeaee-f365-4d8c-b74e-ed9f1b7ac270 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:03.586026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 53/111] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:03.587604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7cbf1-3c3c-4dc1-ad16-fde5ea0feb42 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:03.588420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7cbf1-3c3c-4dc1-ad16-fde5ea0feb42 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:03.588721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7cbf1-3c3c-4dc1-ad16-fde5ea0feb42 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.590518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 54/112] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:03.596789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442aa6c-41b1-4a29-8d29-4c9c93d2b2ba None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:03.596789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442aa6c-41b1-4a29-8d29-4c9c93d2b2ba None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:03.596789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442aa6c-41b1-4a29-8d29-4c9c93d2b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.603395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:03.620837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2442aa6c-41b1-4a29-8d29-4c9c93d2b2ba None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:03.622147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2442aa6c-41b1-4a29-8d29-4c9c93d2b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:03.657746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feeaee-f365-4d8c-b74e-ed9f1b7ac270 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:03.707075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a910418-a1bb-4c0c-a9cc-025b2ded1f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:03.708771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a910418-a1bb-4c0c-a9cc-025b2ded1f34 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:03.709403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a910418-a1bb-4c0c-a9cc-025b2ded1f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:03.710072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a910418-a1bb-4c0c-a9cc-025b2ded1f34 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.712283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a910418-a1bb-4c0c-a9cc-025b2ded1f34 None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:03.716141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a910418-a1bb-4c0c-a9cc-025b2ded1f34 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:03.719311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 59/113] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:03 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:03.720606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a910418-a1bb-4c0c-a9cc-025b2ded1f34 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:03.801483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 55/114] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:03.802658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442aa6c-41b1-4a29-8d29-4c9c93d2b2ba None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:03.839780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a910418-a1bb-4c0c-a9cc-025b2ded1f34 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:03.868193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:03.880816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:03.884444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5e72a-f9a2-4256-9984-1a1f6b39c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:03.885587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5e72a-f9a2-4256-9984-1a1f6b39c0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:03.886139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5e72a-f9a2-4256-9984-1a1f6b39c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:03.886624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5e72a-f9a2-4256-9984-1a1f6b39c0b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.900938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5e72a-f9a2-4256-9984-1a1f6b39c0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-75a5e72a-f9a2-4256-9984-1a1f6b39c0b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:03.907783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:03.909619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:03.910738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:03.913578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 60/115] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:03.915550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f249e-f2bf-49b3-8e7a-b379d34a83e6 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:03.915993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f249e-f2bf-49b3-8e7a-b379d34a83e6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:03.916396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f249e-f2bf-49b3-8e7a-b379d34a83e6 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:03.918105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 61/116] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:03.919084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f249e-f2bf-49b3-8e7a-b379d34a83e6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:04.001029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442aa6c-41b1-4a29-8d29-4c9c93d2b2ba None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:04.061591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cdc8b-0341-43a6-8ed4-86bb42667705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:04.062131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cdc8b-0341-43a6-8ed4-86bb42667705 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.062406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cdc8b-0341-43a6-8ed4-86bb42667705 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.062852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cdc8b-0341-43a6-8ed4-86bb42667705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.063619 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cdc8b-0341-43a6-8ed4-86bb42667705 None admin] RBAC: Adding query filter params (role.id=59ee78b0895446c0b5244158b1252b64, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc, user.id=e2b0b629e6ab46148f89bd99cce01ad6) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:04.063956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cdc8b-0341-43a6-8ed4-86bb42667705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:04.065472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cdc8b-0341-43a6-8ed4-86bb42667705 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:04.067946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f249e-f2bf-49b3-8e7a-b379d34a83e6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:04.072094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 56/117] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:03 2022] GET /identity/v3/role_assignments?user.id=e2b0b629e6ab46148f89bd99cce01ad6&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=59ee78b0895446c0b5244158b1252b64 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:04.073367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4f81-a126-41c7-a3ee-23ddd703358e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.073655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4f81-a126-41c7-a3ee-23ddd703358e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.073923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4f81-a126-41c7-a3ee-23ddd703358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.096925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c2bb4f81-a126-41c7-a3ee-23ddd703358e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:04.098598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c2bb4f81-a126-41c7-a3ee-23ddd703358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:04.140540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6ec0-bc0d-43da-adc1-be726f493aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:04.141178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6ec0-bc0d-43da-adc1-be726f493aef None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.141463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6ec0-bc0d-43da-adc1-be726f493aef None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.141743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6ec0-bc0d-43da-adc1-be726f493aef None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.142427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6ec0-bc0d-43da-adc1-be726f493aef None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:04.142822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6ec0-bc0d-43da-adc1-be726f493aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:04.144863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6ec0-bc0d-43da-adc1-be726f493aef None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:04.160448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 62/118] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:04.164119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6ec0-bc0d-43da-adc1-be726f493aef None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:04.194956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 57/119] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:04.200524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4f81-a126-41c7-a3ee-23ddd703358e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:04.228463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:04.272098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:04.316755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6ec0-bc0d-43da-adc1-be726f493aef None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:04.357551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25286341-1bc9-4968-bb0c-f278819ecb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:04.358570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25286341-1bc9-4968-bb0c-f278819ecb08 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.359041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25286341-1bc9-4968-bb0c-f278819ecb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.359502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25286341-1bc9-4968-bb0c-f278819ecb08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.372214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25286341-1bc9-4968-bb0c-f278819ecb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-25286341-1bc9-4968-bb0c-f278819ecb08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:04.378590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:04.379456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:04.380318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:04.382827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 63/120] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:04.384240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25286341-1bc9-4968-bb0c-f278819ecb08 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:04.413352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4f81-a126-41c7-a3ee-23ddd703358e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:04.485857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56e686-115a-4b62-bbda-9ae9b8c9ca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:04.487207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56e686-115a-4b62-bbda-9ae9b8c9ca03 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.487533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56e686-115a-4b62-bbda-9ae9b8c9ca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.487843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56e686-115a-4b62-bbda-9ae9b8c9ca03 None admin] PATH_INFO: `/v3/users/732cad40509a4bc799b9ef3a107f5645` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.492803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56e686-115a-4b62-bbda-9ae9b8c9ca03 None admin] RBAC: Authorizing `identity:get_user(user_id=732cad40509a4bc799b9ef3a107f5645)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:04.494546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56e686-115a-4b62-bbda-9ae9b8c9ca03 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:04.496834 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 58/121] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:04 2022] GET /identity/v3/users/732cad40509a4bc799b9ef3a107f5645 => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:04.498020 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56e686-115a-4b62-bbda-9ae9b8c9ca03 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:04.515008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25286341-1bc9-4968-bb0c-f278819ecb08 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:04.518614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:04.557421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bb15-ace9-4c65-a85c-c54b64967863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:04.558437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bb15-ace9-4c65-a85c-c54b64967863 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.558908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bb15-ace9-4c65-a85c-c54b64967863 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.559373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bb15-ace9-4c65-a85c-c54b64967863 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.572086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8bb15-ace9-4c65-a85c-c54b64967863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e0c8bb15-ace9-4c65-a85c-c54b64967863 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:04.577334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:04.578201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:04.578955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:04.581346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 64/122] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:04.583211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bb15-ace9-4c65-a85c-c54b64967863 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:04.690658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:04.699778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56e686-115a-4b62-bbda-9ae9b8c9ca03 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:04.722949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bb15-ace9-4c65-a85c-c54b64967863 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:04.748153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508c6c-2b25-4652-9e7d-277e50f10872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:04.748792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508c6c-2b25-4652-9e7d-277e50f10872 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.749067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508c6c-2b25-4652-9e7d-277e50f10872 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.749342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508c6c-2b25-4652-9e7d-277e50f10872 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.750025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508c6c-2b25-4652-9e7d-277e50f10872 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:04.750585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508c6c-2b25-4652-9e7d-277e50f10872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:04.752515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508c6c-2b25-4652-9e7d-277e50f10872 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:04.764516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 59/123] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:04.765475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508c6c-2b25-4652-9e7d-277e50f10872 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:04.773112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e5ae-6599-4cab-bcc8-3040f0aea40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:04.774145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e5ae-6599-4cab-bcc8-3040f0aea40c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.774615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e5ae-6599-4cab-bcc8-3040f0aea40c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.775073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79e5ae-6599-4cab-bcc8-3040f0aea40c None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.776472 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79e5ae-6599-4cab-bcc8-3040f0aea40c None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:04.778344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79e5ae-6599-4cab-bcc8-3040f0aea40c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:04.780830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 65/124] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:04 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:04.781962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e5ae-6599-4cab-bcc8-3040f0aea40c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:04.826068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:04.924626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508c6c-2b25-4652-9e7d-277e50f10872 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:04.929785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79e5ae-6599-4cab-bcc8-3040f0aea40c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:04.974852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bc3d6-8277-42cc-9fd3-4088e736696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:04.975773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bc3d6-8277-42cc-9fd3-4088e736696d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.976050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bc3d6-8277-42cc-9fd3-4088e736696d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.976324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bc3d6-8277-42cc-9fd3-4088e736696d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.976724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1eb83-7c76-435f-a364-ab7bf16aa0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:04.976997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bc3d6-8277-42cc-9fd3-4088e736696d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:04.977300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bc3d6-8277-42cc-9fd3-4088e736696d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:04.977958 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1eb83-7c76-435f-a364-ab7bf16aa0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:04.978424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1eb83-7c76-435f-a364-ab7bf16aa0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:04.978677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bc3d6-8277-42cc-9fd3-4088e736696d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:04.979085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1eb83-7c76-435f-a364-ab7bf16aa0a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:04.990067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 60/125] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:04.990924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bc3d6-8277-42cc-9fd3-4088e736696d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:04.998193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1eb83-7c76-435f-a364-ab7bf16aa0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8ec1eb83-7c76-435f-a364-ab7bf16aa0a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:05.003212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:05.004189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:05.004949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 66/126] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:05.005568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1eb83-7c76-435f-a364-ab7bf16aa0a6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:05.024772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:05.129771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:05.145034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1eb83-7c76-435f-a364-ab7bf16aa0a6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:05.146062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bc3d6-8277-42cc-9fd3-4088e736696d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:05.186871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6c99-8dac-4b37-91c9-64083b265359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:05.188042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6c99-8dac-4b37-91c9-64083b265359 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.188499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6c99-8dac-4b37-91c9-64083b265359 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.189143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6c99-8dac-4b37-91c9-64083b265359 None admin] PATH_INFO: `/v3/users/4130eba1ceda435c8baed39723df5c8e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.190365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c6c99-8dac-4b37-91c9-64083b265359 None admin] RBAC: Authorizing `identity:get_user(user_id=4130eba1ceda435c8baed39723df5c8e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:05.192001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c6c99-8dac-4b37-91c9-64083b265359 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:05.194359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 61/127] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:04 2022] GET /identity/v3/users/4130eba1ceda435c8baed39723df5c8e => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:05.195157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00521-7762-4df1-b29c-99a40a6adc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:05.195299 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6c99-8dac-4b37-91c9-64083b265359 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:05.196264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00521-7762-4df1-b29c-99a40a6adc92 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.196806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00521-7762-4df1-b29c-99a40a6adc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.197277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00521-7762-4df1-b29c-99a40a6adc92 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/users/732cad40509a4bc799b9ef3a107f5645/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.200515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00521-7762-4df1-b29c-99a40a6adc92 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c595f0dd4dc4be48e21e5267bea2ccc, user_id=732cad40509a4bc799b9ef3a107f5645, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:05.201994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00521-7762-4df1-b29c-99a40a6adc92 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:05.267243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 67/128] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:58:05 2022] PUT /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/users/732cad40509a4bc799b9ef3a107f5645/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:05.268535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00521-7762-4df1-b29c-99a40a6adc92 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:05.358513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:05.384881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6c99-8dac-4b37-91c9-64083b265359 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:05.443631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397849-b131-41ea-a21a-f0e9dca1073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:05.444698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397849-b131-41ea-a21a-f0e9dca1073b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.444698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397849-b131-41ea-a21a-f0e9dca1073b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.444974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c397849-b131-41ea-a21a-f0e9dca1073b None admin] PATH_INFO: `/v3/users/732cad40509a4bc799b9ef3a107f5645` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.446182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c397849-b131-41ea-a21a-f0e9dca1073b None admin] RBAC: Authorizing `identity:get_user(user_id=732cad40509a4bc799b9ef3a107f5645)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:05.447698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c397849-b131-41ea-a21a-f0e9dca1073b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:05.449861 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 62/129] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:05 2022] GET /identity/v3/users/732cad40509a4bc799b9ef3a107f5645 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:05.451108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397849-b131-41ea-a21a-f0e9dca1073b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:05.483927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00521-7762-4df1-b29c-99a40a6adc92 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:05.535655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406868f0-ee09-4c0d-9788-a1111de314bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:05.536324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406868f0-ee09-4c0d-9788-a1111de314bc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.536572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406868f0-ee09-4c0d-9788-a1111de314bc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.536857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406868f0-ee09-4c0d-9788-a1111de314bc None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.537549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406868f0-ee09-4c0d-9788-a1111de314bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:05.537857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406868f0-ee09-4c0d-9788-a1111de314bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:05.539364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406868f0-ee09-4c0d-9788-a1111de314bc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:05.561852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 68/130] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:05.562742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406868f0-ee09-4c0d-9788-a1111de314bc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:05.571325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c397849-b131-41ea-a21a-f0e9dca1073b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:05.579662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:05.612558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5eac4-f9c4-4888-8fc9-c5d00100cefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:05.613633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5eac4-f9c4-4888-8fc9-c5d00100cefa None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.613951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5eac4-f9c4-4888-8fc9-c5d00100cefa None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.614207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5eac4-f9c4-4888-8fc9-c5d00100cefa None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.615443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5eac4-f9c4-4888-8fc9-c5d00100cefa None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:05.616978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5eac4-f9c4-4888-8fc9-c5d00100cefa None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:05.619139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 63/131] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:05 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:05.620373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eece3-c285-40a5-82b3-16092089e43d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.620633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eece3-c285-40a5-82b3-16092089e43d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.620910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eece3-c285-40a5-82b3-16092089e43d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.622175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 64/132] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:05.622892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eece3-c285-40a5-82b3-16092089e43d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:05.650730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:05.684421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406868f0-ee09-4c0d-9788-a1111de314bc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:05.722888 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f66fd-3af2-4b5c-bc0a-b2cd635e1f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:05.723670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f66fd-3af2-4b5c-bc0a-b2cd635e1f25 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.724064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f66fd-3af2-4b5c-bc0a-b2cd635e1f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.724412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f66fd-3af2-4b5c-bc0a-b2cd635e1f25 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.725694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f66fd-3af2-4b5c-bc0a-b2cd635e1f25 None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:05.727214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f66fd-3af2-4b5c-bc0a-b2cd635e1f25 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:05.729343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 69/133] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:05 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:05.730268 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f66fd-3af2-4b5c-bc0a-b2cd635e1f25 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:05.763454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eece3-c285-40a5-82b3-16092089e43d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:05.818580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e48093-8e26-45ca-b2a7-54f7f55c3ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:05.819465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e48093-8e26-45ca-b2a7-54f7f55c3ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.819832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e48093-8e26-45ca-b2a7-54f7f55c3ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.820110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e48093-8e26-45ca-b2a7-54f7f55c3ac3 None admin] PATH_INFO: `/v3/users/732cad40509a4bc799b9ef3a107f5645` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.821873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e48093-8e26-45ca-b2a7-54f7f55c3ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=732cad40509a4bc799b9ef3a107f5645)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:05.823594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e48093-8e26-45ca-b2a7-54f7f55c3ac3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:05.825364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 65/134] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:05 2022] GET /identity/v3/users/732cad40509a4bc799b9ef3a107f5645 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:05.826530 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581b2b5-2724-45ef-bea1-bf36ed26428c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.826810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581b2b5-2724-45ef-bea1-bf36ed26428c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.827077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581b2b5-2724-45ef-bea1-bf36ed26428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.830796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:05.852302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2581b2b5-2724-45ef-bea1-bf36ed26428c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:05.854135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f66fd-3af2-4b5c-bc0a-b2cd635e1f25 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:05.854955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2581b2b5-2724-45ef-bea1-bf36ed26428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:05.893513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e03a69-ff86-427f-a4be-76b03afd401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:05.894772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e03a69-ff86-427f-a4be-76b03afd401a None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:05.895199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e03a69-ff86-427f-a4be-76b03afd401a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:05.895615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e03a69-ff86-427f-a4be-76b03afd401a None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/users/4130eba1ceda435c8baed39723df5c8e/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:05.897799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e03a69-ff86-427f-a4be-76b03afd401a None admin] RBAC: Authorizing `identity:create_grant(project_id=3c595f0dd4dc4be48e21e5267bea2ccc, user_id=4130eba1ceda435c8baed39723df5c8e, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:05.899523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e03a69-ff86-427f-a4be-76b03afd401a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:05.945686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 66/135] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:05.947332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581b2b5-2724-45ef-bea1-bf36ed26428c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:05.985161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 70/136] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:58:05 2022] PUT /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/users/4130eba1ceda435c8baed39723df5c8e/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:05.986931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e03a69-ff86-427f-a4be-76b03afd401a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:06.020265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.263859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e03a69-ff86-427f-a4be-76b03afd401a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:06.331759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581b2b5-2724-45ef-bea1-bf36ed26428c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:06.338680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35297f-4235-4e36-8f8e-c23d1ef64b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:06.339576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35297f-4235-4e36-8f8e-c23d1ef64b2c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:06.340015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35297f-4235-4e36-8f8e-c23d1ef64b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:06.340423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35297f-4235-4e36-8f8e-c23d1ef64b2c None admin] PATH_INFO: `/v3/projects/f23dc36a79354b458faadbe1a6e3b118` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:06.343502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35297f-4235-4e36-8f8e-c23d1ef64b2c None admin] RBAC: Authorizing `identity:get_project(project_id=f23dc36a79354b458faadbe1a6e3b118)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:06.345285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35297f-4235-4e36-8f8e-c23d1ef64b2c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:06.347993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 71/137] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:05 2022] GET /identity/v3/projects/f23dc36a79354b458faadbe1a6e3b118 => generated 312 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:06.354322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35297f-4235-4e36-8f8e-c23d1ef64b2c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:06.378996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.383958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a90ce0-a320-4e03-a6fa-883f3efaa40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:06.384816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a90ce0-a320-4e03-a6fa-883f3efaa40e None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:06.385286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a90ce0-a320-4e03-a6fa-883f3efaa40e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:06.389533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a90ce0-a320-4e03-a6fa-883f3efaa40e None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/users/732cad40509a4bc799b9ef3a107f5645/roles/ff90bae50e0644739e4bdec7431da2e0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:06.389533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a90ce0-a320-4e03-a6fa-883f3efaa40e None admin] RBAC: Authorizing `identity:create_grant(project_id=3c595f0dd4dc4be48e21e5267bea2ccc, user_id=732cad40509a4bc799b9ef3a107f5645, role_id=ff90bae50e0644739e4bdec7431da2e0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:06.389533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a90ce0-a320-4e03-a6fa-883f3efaa40e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:06.494488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 67/138] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:58:05 2022] PUT /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/users/732cad40509a4bc799b9ef3a107f5645/roles/ff90bae50e0644739e4bdec7431da2e0 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:06.495365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a90ce0-a320-4e03-a6fa-883f3efaa40e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:06.539003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35297f-4235-4e36-8f8e-c23d1ef64b2c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:06.589593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d305c39-3bc8-40dd-aa03-fc7dc1defea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:06.590735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d305c39-3bc8-40dd-aa03-fc7dc1defea4 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:06.591255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d305c39-3bc8-40dd-aa03-fc7dc1defea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:06.591758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d305c39-3bc8-40dd-aa03-fc7dc1defea4 None admin] PATH_INFO: `/v3/projects/f23dc36a79354b458faadbe1a6e3b118/users/732cad40509a4bc799b9ef3a107f5645/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:06.596216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d305c39-3bc8-40dd-aa03-fc7dc1defea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f23dc36a79354b458faadbe1a6e3b118, user_id=732cad40509a4bc799b9ef3a107f5645, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:06.601769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d305c39-3bc8-40dd-aa03-fc7dc1defea4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:06.660004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.687891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a90ce0-a320-4e03-a6fa-883f3efaa40e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:06.728569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241244c4-79f2-4c84-8b00-79e29e4bb316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:06.729219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241244c4-79f2-4c84-8b00-79e29e4bb316 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:06.729494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241244c4-79f2-4c84-8b00-79e29e4bb316 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:06.729764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241244c4-79f2-4c84-8b00-79e29e4bb316 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:06.730911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241244c4-79f2-4c84-8b00-79e29e4bb316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:06.732464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241244c4-79f2-4c84-8b00-79e29e4bb316 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:06.734216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 68/139] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:06.735436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2001faf-006c-4b0a-ab0a-bb07cf26d151 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:06.735727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2001faf-006c-4b0a-ab0a-bb07cf26d151 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:06.736086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2001faf-006c-4b0a-ab0a-bb07cf26d151 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:06.738033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 69/140] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:06.742219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2001faf-006c-4b0a-ab0a-bb07cf26d151 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:06.744987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 72/141] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:58:06 2022] PUT /identity/v3/projects/f23dc36a79354b458faadbe1a6e3b118/users/732cad40509a4bc799b9ef3a107f5645/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:06.753863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48108137-4db3-4914-8699-5a3c55a05d3f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:06.754591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48108137-4db3-4914-8699-5a3c55a05d3f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:06.755161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48108137-4db3-4914-8699-5a3c55a05d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:06.801206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-48108137-4db3-4914-8699-5a3c55a05d3f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:06.805451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-48108137-4db3-4914-8699-5a3c55a05d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:06.969945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2001faf-006c-4b0a-ab0a-bb07cf26d151 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:06.970463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.986726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 73/142] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:07.042443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16494fec-5c34-417f-9f8b-47a765a12c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:07.043399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16494fec-5c34-417f-9f8b-47a765a12c56 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:07.043906 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16494fec-5c34-417f-9f8b-47a765a12c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:07.044390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16494fec-5c34-417f-9f8b-47a765a12c56 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:07.045597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16494fec-5c34-417f-9f8b-47a765a12c56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:07.048372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16494fec-5c34-417f-9f8b-47a765a12c56 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:07.161094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:07.170985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 70/143] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:58:06 2022] POST /identity/v3/users => generated 283 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:07.549995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48108137-4db3-4914-8699-5a3c55a05d3f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:07.698020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48108137-4db3-4914-8699-5a3c55a05d3f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:07.753830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da15a3-718e-4593-87bf-871a68ab892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:07.757095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da15a3-718e-4593-87bf-871a68ab892f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:07.757095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da15a3-718e-4593-87bf-871a68ab892f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:07.757095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da15a3-718e-4593-87bf-871a68ab892f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:07.776910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da15a3-718e-4593-87bf-871a68ab892f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-75da15a3-718e-4593-87bf-871a68ab892f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:07.782988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:07.784452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:07.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:07.786642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 74/144] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:07.791422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16494fec-5c34-417f-9f8b-47a765a12c56 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:07.934122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad514-8cb4-4008-bf6e-68ecc4040adb None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:07.934528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad514-8cb4-4008-bf6e-68ecc4040adb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:07.934980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad514-8cb4-4008-bf6e-68ecc4040adb None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:07.937217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 75/145] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:07.945964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea762ca8-6524-49ce-a88d-9b36d87f4db7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:07.946340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea762ca8-6524-49ce-a88d-9b36d87f4db7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:07.946513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea762ca8-6524-49ce-a88d-9b36d87f4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:07.967103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16494fec-5c34-417f-9f8b-47a765a12c56 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:07.982858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ea762ca8-6524-49ce-a88d-9b36d87f4db7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:07.984511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ea762ca8-6524-49ce-a88d-9b36d87f4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:08.060605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede8f8-426c-4dc2-bf1a-dd89ebc94ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:08.061296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede8f8-426c-4dc2-bf1a-dd89ebc94ecd None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:08.061534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede8f8-426c-4dc2-bf1a-dd89ebc94ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:08.061804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede8f8-426c-4dc2-bf1a-dd89ebc94ecd None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:08.062635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ede8f8-426c-4dc2-bf1a-dd89ebc94ecd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:08.062953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ede8f8-426c-4dc2-bf1a-dd89ebc94ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:08.064411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ede8f8-426c-4dc2-bf1a-dd89ebc94ecd None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:08.086679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 71/146] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:08.088750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:08.094862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede8f8-426c-4dc2-bf1a-dd89ebc94ecd None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:08.106967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 76/147] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:08.204396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:08.263187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede8f8-426c-4dc2-bf1a-dd89ebc94ecd None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:08.310540 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65fd80-fd65-4274-984a-935464c7f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:08.311575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65fd80-fd65-4274-984a-935464c7f836 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:08.312066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65fd80-fd65-4274-984a-935464c7f836 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:08.312563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65fd80-fd65-4274-984a-935464c7f836 None admin] PATH_INFO: `/v3/users/e2b0b629e6ab46148f89bd99cce01ad6` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:08.316601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65fd80-fd65-4274-984a-935464c7f836 None admin] RBAC: Authorizing `identity:get_user(user_id=e2b0b629e6ab46148f89bd99cce01ad6)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:08.318164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65fd80-fd65-4274-984a-935464c7f836 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:08.320019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 72/148] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:08 2022] GET /identity/v3/users/e2b0b629e6ab46148f89bd99cce01ad6 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:08.326684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea762ca8-6524-49ce-a88d-9b36d87f4db7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:08.532907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea762ca8-6524-49ce-a88d-9b36d87f4db7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:08.590659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd487a-dbc7-44fa-ae1a-a755f254cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:08.591422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd487a-dbc7-44fa-ae1a-a755f254cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:08.591585 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd487a-dbc7-44fa-ae1a-a755f254cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:08.591895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd487a-dbc7-44fa-ae1a-a755f254cfe5 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:08.593088 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd487a-dbc7-44fa-ae1a-a755f254cfe5 None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:08.594557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd487a-dbc7-44fa-ae1a-a755f254cfe5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:08.596764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 77/149] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:08 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:08.609466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65fd80-fd65-4274-984a-935464c7f836 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:08.639635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd487a-dbc7-44fa-ae1a-a755f254cfe5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:08.728139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:08.806811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd487a-dbc7-44fa-ae1a-a755f254cfe5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:08.819817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65fd80-fd65-4274-984a-935464c7f836 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:08.866376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f82cc-c43e-42c9-9692-4e9b78594344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:08.867024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f82cc-c43e-42c9-9692-4e9b78594344 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:08.867297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f82cc-c43e-42c9-9692-4e9b78594344 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:08.867564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f82cc-c43e-42c9-9692-4e9b78594344 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:08.889513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:08.896798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f82cc-c43e-42c9-9692-4e9b78594344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e70f82cc-c43e-42c9-9692-4e9b78594344 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:08.908372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:08.909815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:08.910573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:08.913366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a66807-db29-4e63-89f9-2ef6424e0ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:08.913366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a66807-db29-4e63-89f9-2ef6424e0ece None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:08.913366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a66807-db29-4e63-89f9-2ef6424e0ece None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:08.913633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a66807-db29-4e63-89f9-2ef6424e0ece None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/users/e2b0b629e6ab46148f89bd99cce01ad6/roles/59ee78b0895446c0b5244158b1252b64` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:08.915596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a66807-db29-4e63-89f9-2ef6424e0ece None admin] RBAC: Authorizing `identity:create_grant(project_id=3c595f0dd4dc4be48e21e5267bea2ccc, user_id=e2b0b629e6ab46148f89bd99cce01ad6, role_id=59ee78b0895446c0b5244158b1252b64)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:08.921542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a66807-db29-4e63-89f9-2ef6424e0ece None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:08.925385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 78/150] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:08.926138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f82cc-c43e-42c9-9692-4e9b78594344 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:09.004223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 73/151] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:58:08 2022] PUT /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/users/e2b0b629e6ab46148f89bd99cce01ad6/roles/59ee78b0895446c0b5244158b1252b64 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:09.072111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f82cc-c43e-42c9-9692-4e9b78594344 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:09.092145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:09.116210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c07e7-88f8-4a9f-ae79-cc08efdf2c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:09.116848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c07e7-88f8-4a9f-ae79-cc08efdf2c77 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:09.117124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c07e7-88f8-4a9f-ae79-cc08efdf2c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:09.117394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c07e7-88f8-4a9f-ae79-cc08efdf2c77 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:09.118077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c07e7-88f8-4a9f-ae79-cc08efdf2c77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:09.118376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c07e7-88f8-4a9f-ae79-cc08efdf2c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:09.120224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c07e7-88f8-4a9f-ae79-cc08efdf2c77 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:09.137517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 79/152] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:09.144623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a66807-db29-4e63-89f9-2ef6424e0ece None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:09.158972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab9c1c-27b9-4ea1-8ef1-92f517bd2cb9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:09.159304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab9c1c-27b9-4ea1-8ef1-92f517bd2cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:09.159554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab9c1c-27b9-4ea1-8ef1-92f517bd2cb9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:09.161044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 80/153] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:09.167516 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69710c0e-de72-46d1-a099-37184145b776 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:09.167847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69710c0e-de72-46d1-a099-37184145b776 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:09.168083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69710c0e-de72-46d1-a099-37184145b776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:09.211681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-69710c0e-de72-46d1-a099-37184145b776 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:09.212912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-69710c0e-de72-46d1-a099-37184145b776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:09.385758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 81/154] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:09.394066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a66807-db29-4e63-89f9-2ef6424e0ece None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:09.447468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2950dc-7413-447a-82e2-24591e990d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:09.448531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2950dc-7413-447a-82e2-24591e990d9c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:09.449028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2950dc-7413-447a-82e2-24591e990d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:09.449576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2950dc-7413-447a-82e2-24591e990d9c None admin] PATH_INFO: `/v3/users/732cad40509a4bc799b9ef3a107f5645` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:09.451024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2950dc-7413-447a-82e2-24591e990d9c None admin] RBAC: Authorizing `identity:get_user(user_id=732cad40509a4bc799b9ef3a107f5645)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:09.452929 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2950dc-7413-447a-82e2-24591e990d9c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:09.454873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 74/155] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:09 2022] GET /identity/v3/users/732cad40509a4bc799b9ef3a107f5645 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:09.463425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69710c0e-de72-46d1-a099-37184145b776 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:09.610939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69710c0e-de72-46d1-a099-37184145b776 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:09.622131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:09.650245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763201b4-1b6c-4381-8200-7bfccf136e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:09.650785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763201b4-1b6c-4381-8200-7bfccf136e5d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:09.651052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763201b4-1b6c-4381-8200-7bfccf136e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:09.651317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763201b4-1b6c-4381-8200-7bfccf136e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:09.735705 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763201b4-1b6c-4381-8200-7bfccf136e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:09.737746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763201b4-1b6c-4381-8200-7bfccf136e5d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:09.899943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 82/156] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:09.908008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2950dc-7413-447a-82e2-24591e990d9c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:09.993762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:10.045459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2950dc-7413-447a-82e2-24591e990d9c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:10.087278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad21a4-5320-4491-b417-7a4cac713d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:10.088191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad21a4-5320-4491-b417-7a4cac713d7e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:10.088645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad21a4-5320-4491-b417-7a4cac713d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:10.089069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad21a4-5320-4491-b417-7a4cac713d7e None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:10.090350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad21a4-5320-4491-b417-7a4cac713d7e None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:10.091985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad21a4-5320-4491-b417-7a4cac713d7e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:10.094098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 75/157] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:09 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:10.100812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763201b4-1b6c-4381-8200-7bfccf136e5d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:10.119789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:10.256105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763201b4-1b6c-4381-8200-7bfccf136e5d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:10.273240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad21a4-5320-4491-b417-7a4cac713d7e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:10.314551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02745-51f9-4365-a4f6-297ad0207b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:10.315403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02745-51f9-4365-a4f6-297ad0207b1f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:10.315696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02745-51f9-4365-a4f6-297ad0207b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:10.315966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02745-51f9-4365-a4f6-297ad0207b1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:10.316720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02745-51f9-4365-a4f6-297ad0207b1f None admin] RBAC: Adding query filter params (role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc, user.id=732cad40509a4bc799b9ef3a107f5645) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:10.317028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02745-51f9-4365-a4f6-297ad0207b1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:10.324236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02745-51f9-4365-a4f6-297ad0207b1f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:10.329219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 83/158] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:10 2022] GET /identity/v3/role_assignments?user.id=732cad40509a4bc799b9ef3a107f5645&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:10.421277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad21a4-5320-4491-b417-7a4cac713d7e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:10.453103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:10.462298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c08f1-ea15-429b-8875-4d0fc0aebd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:10.465308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c08f1-ea15-429b-8875-4d0fc0aebd79 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:10.465308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c08f1-ea15-429b-8875-4d0fc0aebd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:10.465308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c08f1-ea15-429b-8875-4d0fc0aebd79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:10.481874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c08f1-ea15-429b-8875-4d0fc0aebd79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-436c08f1-ea15-429b-8875-4d0fc0aebd79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:10.488090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:10.489065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:10.489939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:10.492926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 76/159] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:58:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:10.498417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02745-51f9-4365-a4f6-297ad0207b1f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:10.607459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:10.645284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02745-51f9-4365-a4f6-297ad0207b1f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:10.692460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ba6f2-fe5f-4829-a429-24bb5409ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:10.693195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ba6f2-fe5f-4829-a429-24bb5409ddbf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:10.693497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ba6f2-fe5f-4829-a429-24bb5409ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:10.693774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ba6f2-fe5f-4829-a429-24bb5409ddbf None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:10.694668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ba6f2-fe5f-4829-a429-24bb5409ddbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:10.694981 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ba6f2-fe5f-4829-a429-24bb5409ddbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:10.696464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ba6f2-fe5f-4829-a429-24bb5409ddbf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:10.712486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 84/160] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:10.717753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c08f1-ea15-429b-8875-4d0fc0aebd79 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:10.855357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7418ad-1335-448a-8e0f-dae5314a2f86 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:10.856070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7418ad-1335-448a-8e0f-dae5314a2f86 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:10.856070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7418ad-1335-448a-8e0f-dae5314a2f86 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:10.857933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 85/161] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:10.865205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2c530-9a14-45fd-b774-2123c2a09ce2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:10.865510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2c530-9a14-45fd-b774-2123c2a09ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:10.865760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2c530-9a14-45fd-b774-2123c2a09ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:10.878814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c08f1-ea15-429b-8875-4d0fc0aebd79 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:10.912888 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-26c2c530-9a14-45fd-b774-2123c2a09ce2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:10.914106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-26c2c530-9a14-45fd-b774-2123c2a09ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:10.931521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c707b-e733-4f7d-9a53-c27a3d8a8edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:10.932666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c707b-e733-4f7d-9a53-c27a3d8a8edd None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:10.933162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c707b-e733-4f7d-9a53-c27a3d8a8edd None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:10.933653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c707b-e733-4f7d-9a53-c27a3d8a8edd None admin] PATH_INFO: `/v3/users/4130eba1ceda435c8baed39723df5c8e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:10.941181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c707b-e733-4f7d-9a53-c27a3d8a8edd None admin] RBAC: Authorizing `identity:get_user(user_id=4130eba1ceda435c8baed39723df5c8e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:10.943193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c707b-e733-4f7d-9a53-c27a3d8a8edd None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:10.945234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 77/162] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:10 2022] GET /identity/v3/users/4130eba1ceda435c8baed39723df5c8e => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:10.960845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c707b-e733-4f7d-9a53-c27a3d8a8edd None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:11.034806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 86/163] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:11.056143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:11.113112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c707b-e733-4f7d-9a53-c27a3d8a8edd None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:11.136751 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fa486-6db7-40b7-9e67-c0345b0a6419 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:11.137056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fa486-6db7-40b7-9e67-c0345b0a6419 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:11.137298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fa486-6db7-40b7-9e67-c0345b0a6419 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:11.138813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 87/164] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:58:11.149260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bfc5-17cf-4d2b-823d-73a209ba5b34 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:11.149578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bfc5-17cf-4d2b-823d-73a209ba5b34 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:11.149809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bfc5-17cf-4d2b-823d-73a209ba5b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:11.171548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f6d80-65e9-44b8-845e-aeef7975aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:11.172316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6d80-65e9-44b8-845e-aeef7975aa01 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:11.172604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6d80-65e9-44b8-845e-aeef7975aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:11.172885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6d80-65e9-44b8-845e-aeef7975aa01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:11.187279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9233bfc5-17cf-4d2b-823d-73a209ba5b34 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:11.188583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9233bfc5-17cf-4d2b-823d-73a209ba5b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:11.278190 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f6d80-65e9-44b8-845e-aeef7975aa01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:11.279705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f6d80-65e9-44b8-845e-aeef7975aa01 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:11.297199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:11.326973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 88/165] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:11.372246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:11.442844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 78/166] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:11.448477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233bfc5-17cf-4d2b-823d-73a209ba5b34 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:11.605013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233bfc5-17cf-4d2b-823d-73a209ba5b34 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:11.677503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cccec-4506-4fa5-9787-c3ec2f43c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:11.678433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cccec-4506-4fa5-9787-c3ec2f43c02e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:11.678892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cccec-4506-4fa5-9787-c3ec2f43c02e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:11.679308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cccec-4506-4fa5-9787-c3ec2f43c02e None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:11.681150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cccec-4506-4fa5-9787-c3ec2f43c02e None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:11.683506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cccec-4506-4fa5-9787-c3ec2f43c02e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:11.686525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 89/167] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:11 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:11.695783 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f6d80-65e9-44b8-845e-aeef7975aa01 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:11.730308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cccec-4506-4fa5-9787-c3ec2f43c02e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:11.855649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f6d80-65e9-44b8-845e-aeef7975aa01 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:11.886535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:11.926046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f6d7-48fb-4e5c-b919-aa283f04be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:11.926689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f6d7-48fb-4e5c-b919-aa283f04be85 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:11.926974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f6d7-48fb-4e5c-b919-aa283f04be85 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:11.927499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f6d7-48fb-4e5c-b919-aa283f04be85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:11.928350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96f6d7-48fb-4e5c-b919-aa283f04be85 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc, user.id=4130eba1ceda435c8baed39723df5c8e) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:11.928604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96f6d7-48fb-4e5c-b919-aa283f04be85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:11.931822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96f6d7-48fb-4e5c-b919-aa283f04be85 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:11.941511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 79/168] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:11 2022] GET /identity/v3/role_assignments?user.id=4130eba1ceda435c8baed39723df5c8e&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=55aed406476a485f99f9815f9f27cb3b => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:11.942630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9c176-1a5e-4f73-996c-0f8f7a251e01 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:11.942924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9c176-1a5e-4f73-996c-0f8f7a251e01 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:11.943204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9c176-1a5e-4f73-996c-0f8f7a251e01 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:11.952882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 80/169] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:11.962558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251d24e-94fe-4a5a-85f5-20b3a38aabbe None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:11.962899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251d24e-94fe-4a5a-85f5-20b3a38aabbe None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:11.963170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251d24e-94fe-4a5a-85f5-20b3a38aabbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:11.978870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cccec-4506-4fa5-9787-c3ec2f43c02e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:12.000501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9251d24e-94fe-4a5a-85f5-20b3a38aabbe None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:12.001740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9251d24e-94fe-4a5a-85f5-20b3a38aabbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:12.023031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:12.058686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfad7ef-19f1-425a-9891-b2c812426535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:12.059713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfad7ef-19f1-425a-9891-b2c812426535 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:12.060234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfad7ef-19f1-425a-9891-b2c812426535 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:12.060713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfad7ef-19f1-425a-9891-b2c812426535 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:12.087060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfad7ef-19f1-425a-9891-b2c812426535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8dfad7ef-19f1-425a-9891-b2c812426535 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:12.092714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:12.093645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:12.094442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:12.098009 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 90/170] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:12.104571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfad7ef-19f1-425a-9891-b2c812426535 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:12.126201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 81/171] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:12.190896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251d24e-94fe-4a5a-85f5-20b3a38aabbe None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:12.308548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfad7ef-19f1-425a-9891-b2c812426535 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:12.350951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:12.391641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5bf51-a77c-425c-97ce-918d6ad7977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:12.392812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5bf51-a77c-425c-97ce-918d6ad7977f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:12.393332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5bf51-a77c-425c-97ce-918d6ad7977f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:12.393924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5bf51-a77c-425c-97ce-918d6ad7977f None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:12.394833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5bf51-a77c-425c-97ce-918d6ad7977f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:12.395350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5bf51-a77c-425c-97ce-918d6ad7977f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:12.397016 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5bf51-a77c-425c-97ce-918d6ad7977f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:12.402060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251d24e-94fe-4a5a-85f5-20b3a38aabbe None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:12.422234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 91/172] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:12.430265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5bf51-a77c-425c-97ce-918d6ad7977f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:12.477819 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedf768-788f-43e8-bc05-2a230b7c4869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:12.478726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedf768-788f-43e8-bc05-2a230b7c4869 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:12.479181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedf768-788f-43e8-bc05-2a230b7c4869 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:12.479867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedf768-788f-43e8-bc05-2a230b7c4869 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:12.504448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedf768-788f-43e8-bc05-2a230b7c4869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-bdedf768-788f-43e8-bc05-2a230b7c4869 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:12.515780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:12.516776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:12.518128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 82/173] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:12.518866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedf768-788f-43e8-bc05-2a230b7c4869 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:12.536370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:12.675167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5bf51-a77c-425c-97ce-918d6ad7977f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:12.747566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04844338-7ad9-4eba-bd4c-9521ee43bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:12.749105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04844338-7ad9-4eba-bd4c-9521ee43bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:12.750509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04844338-7ad9-4eba-bd4c-9521ee43bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:12.752752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04844338-7ad9-4eba-bd4c-9521ee43bdb9 None admin] PATH_INFO: `/v3/users/732cad40509a4bc799b9ef3a107f5645` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:12.755476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedf768-788f-43e8-bc05-2a230b7c4869 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:12.758708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04844338-7ad9-4eba-bd4c-9521ee43bdb9 None admin] RBAC: Authorizing `identity:get_user(user_id=732cad40509a4bc799b9ef3a107f5645)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:12.760478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04844338-7ad9-4eba-bd4c-9521ee43bdb9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:12.762339 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 92/174] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:12 2022] GET /identity/v3/users/732cad40509a4bc799b9ef3a107f5645 => generated 275 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:12.768938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04844338-7ad9-4eba-bd4c-9521ee43bdb9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:12.822192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f867be-36a1-4fe2-9265-ab2fd97fd672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:12.823210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f867be-36a1-4fe2-9265-ab2fd97fd672 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:12.823849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f867be-36a1-4fe2-9265-ab2fd97fd672 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:12.824324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f867be-36a1-4fe2-9265-ab2fd97fd672 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:12.825220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f867be-36a1-4fe2-9265-ab2fd97fd672 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:12.825742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f867be-36a1-4fe2-9265-ab2fd97fd672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:12.837461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f867be-36a1-4fe2-9265-ab2fd97fd672 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:12.848341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 83/175] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:12.849667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f867be-36a1-4fe2-9265-ab2fd97fd672 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:12.929877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:12.931139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:12.967437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f867be-36a1-4fe2-9265-ab2fd97fd672 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.008519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4897df-c1d5-43ba-ba8f-cfa796fa7e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.009490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4897df-c1d5-43ba-ba8f-cfa796fa7e00 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.009977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4897df-c1d5-43ba-ba8f-cfa796fa7e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.010473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4897df-c1d5-43ba-ba8f-cfa796fa7e00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.046752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04844338-7ad9-4eba-bd4c-9521ee43bdb9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.099941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d40fd2-7161-4de2-b5e2-07f0a3123927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.100875 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d40fd2-7161-4de2-b5e2-07f0a3123927 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.101151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d40fd2-7161-4de2-b5e2-07f0a3123927 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.101419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d40fd2-7161-4de2-b5e2-07f0a3123927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.105663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4897df-c1d5-43ba-ba8f-cfa796fa7e00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.107153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4897df-c1d5-43ba-ba8f-cfa796fa7e00 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.114121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d40fd2-7161-4de2-b5e2-07f0a3123927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-80d40fd2-7161-4de2-b5e2-07f0a3123927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:13.119580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:13.120499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:13.121278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 93/176] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:58:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:13.121926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d40fd2-7161-4de2-b5e2-07f0a3123927 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.188864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:13.231370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 84/177] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:13.232699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c6bf6-f60a-4217-af60-4f917302316f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.232984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c6bf6-f60a-4217-af60-4f917302316f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.233320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c6bf6-f60a-4217-af60-4f917302316f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.234835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 85/178] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:13.235709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1d73b-9308-4feb-b85d-144cbf4d89f5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.236012 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1d73b-9308-4feb-b85d-144cbf4d89f5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.237299 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1d73b-9308-4feb-b85d-144cbf4d89f5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.239010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 86/179] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:13.240087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699993-c53f-4838-9bf1-33a6e3fa502e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.240373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699993-c53f-4838-9bf1-33a6e3fa502e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.240635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699993-c53f-4838-9bf1-33a6e3fa502e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.242306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 87/180] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:13.243791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6699993-c53f-4838-9bf1-33a6e3fa502e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.260862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d40fd2-7161-4de2-b5e2-07f0a3123927 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.274899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:13.297101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b2ea6-b83c-417a-bd1d-942204964ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.297752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b2ea6-b83c-417a-bd1d-942204964ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.298029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b2ea6-b83c-417a-bd1d-942204964ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.298303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b2ea6-b83c-417a-bd1d-942204964ca5 None admin] PATH_INFO: `/v3/users/732cad40509a4bc799b9ef3a107f5645` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.300091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b2ea6-b83c-417a-bd1d-942204964ca5 None admin] RBAC: Authorizing `identity:get_user(user_id=732cad40509a4bc799b9ef3a107f5645)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.301770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b2ea6-b83c-417a-bd1d-942204964ca5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.303660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 94/181] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/users/732cad40509a4bc799b9ef3a107f5645 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:13.304462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b2ea6-b83c-417a-bd1d-942204964ca5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.384570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6699993-c53f-4838-9bf1-33a6e3fa502e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.412373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b2ea6-b83c-417a-bd1d-942204964ca5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.420416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b1568-8ad3-4007-880d-41ab791e6826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.421025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b1568-8ad3-4007-880d-41ab791e6826 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.421300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b1568-8ad3-4007-880d-41ab791e6826 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.421574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b1568-8ad3-4007-880d-41ab791e6826 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.422242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b1568-8ad3-4007-880d-41ab791e6826 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:13.422556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b1568-8ad3-4007-880d-41ab791e6826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.424843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b1568-8ad3-4007-880d-41ab791e6826 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.434019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 88/182] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:13.435652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7dc6f-34d2-452f-b763-abb5910483af None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.435977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7dc6f-34d2-452f-b763-abb5910483af None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.436251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7dc6f-34d2-452f-b763-abb5910483af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.449196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf30d33-4bee-437a-9b20-96ce06de2b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.449915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf30d33-4bee-437a-9b20-96ce06de2b5d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.450102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf30d33-4bee-437a-9b20-96ce06de2b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.450439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf30d33-4bee-437a-9b20-96ce06de2b5d None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.452010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf30d33-4bee-437a-9b20-96ce06de2b5d None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.453517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf30d33-4bee-437a-9b20-96ce06de2b5d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.455033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-80e7dc6f-34d2-452f-b763-abb5910483af None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:13.455173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 95/183] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:13.456342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c8c0-a3b8-4d39-903f-4bc3b686f4dc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.456457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-80e7dc6f-34d2-452f-b763-abb5910483af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.456611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c8c0-a3b8-4d39-903f-4bc3b686f4dc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.456879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c8c0-a3b8-4d39-903f-4bc3b686f4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.475412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1eb5c8c0-a3b8-4d39-903f-4bc3b686f4dc None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:13.476643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1eb5c8c0-a3b8-4d39-903f-4bc3b686f4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.487227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:13.528190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:13.535951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 89/184] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:13.535951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe3e12-9dc6-4e43-a675-76f6888d78b4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.535951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe3e12-9dc6-4e43-a675-76f6888d78b4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.535951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe3e12-9dc6-4e43-a675-76f6888d78b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.555996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0ffe3e12-9dc6-4e43-a675-76f6888d78b4 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:13.557199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0ffe3e12-9dc6-4e43-a675-76f6888d78b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.569593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 96/185] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:13.570709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c8c0-a3b8-4d39-903f-4bc3b686f4dc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.661034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 90/186] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:13.662459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe3e12-9dc6-4e43-a675-76f6888d78b4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.701748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c8c0-a3b8-4d39-903f-4bc3b686f4dc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.744369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9a7c-ca41-4865-8cd3-7ae868178411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.745454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9a7c-ca41-4865-8cd3-7ae868178411 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.745911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9a7c-ca41-4865-8cd3-7ae868178411 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.746356 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9a7c-ca41-4865-8cd3-7ae868178411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.804119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:13.829582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c9a7c-ca41-4865-8cd3-7ae868178411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.831667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c9a7c-ca41-4865-8cd3-7ae868178411 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.892687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:13.911293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe3e12-9dc6-4e43-a675-76f6888d78b4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.963371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 97/187] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:13.963371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9a7c-ca41-4865-8cd3-7ae868178411 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.976306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9984372-22ca-42dc-b62f-842b67b8e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.977104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9984372-22ca-42dc-b62f-842b67b8e65a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.977486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9984372-22ca-42dc-b62f-842b67b8e65a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.977864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9984372-22ca-42dc-b62f-842b67b8e65a None admin] PATH_INFO: `/v3/users/845409167b5c4bb39ad95ad4156ae970` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.001743 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9984372-22ca-42dc-b62f-842b67b8e65a None admin] RBAC: Authorizing `identity:get_user(user_id=845409167b5c4bb39ad95ad4156ae970)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:14.004425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9984372-22ca-42dc-b62f-842b67b8e65a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:14.007003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 91/188] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/users/845409167b5c4bb39ad95ad4156ae970 => generated 283 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:14.007734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9984372-22ca-42dc-b62f-842b67b8e65a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:14.065440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:14.087374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9a7c-ca41-4865-8cd3-7ae868178411 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:14.117042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9984372-22ca-42dc-b62f-842b67b8e65a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:14.123843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66960f1-b5b4-4db5-a3ba-beeea8da826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:14.124488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66960f1-b5b4-4db5-a3ba-beeea8da826d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:14.124763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66960f1-b5b4-4db5-a3ba-beeea8da826d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:14.125034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66960f1-b5b4-4db5-a3ba-beeea8da826d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.125800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66960f1-b5b4-4db5-a3ba-beeea8da826d None admin] RBAC: Adding query filter params (role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc, user.id=732cad40509a4bc799b9ef3a107f5645) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:14.126104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66960f1-b5b4-4db5-a3ba-beeea8da826d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:14.128062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66960f1-b5b4-4db5-a3ba-beeea8da826d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:14.134495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 98/189] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/role_assignments?user.id=732cad40509a4bc799b9ef3a107f5645&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:14.135405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66960f1-b5b4-4db5-a3ba-beeea8da826d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:14.160442 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a9e6f-b758-4bda-8bad-191220d49094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:14.161417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a9e6f-b758-4bda-8bad-191220d49094 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:14.161846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a9e6f-b758-4bda-8bad-191220d49094 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:14.162271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a9e6f-b758-4bda-8bad-191220d49094 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.176447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a9e6f-b758-4bda-8bad-191220d49094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8e9a9e6f-b758-4bda-8bad-191220d49094 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:14.183254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:14.184510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:14.185495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:14.188187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 92/190] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:14.188187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a9e6f-b758-4bda-8bad-191220d49094 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:14.203994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:14.296502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66960f1-b5b4-4db5-a3ba-beeea8da826d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:14.336774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a9e6f-b758-4bda-8bad-191220d49094 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:14.341260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1538065-b4a3-484c-b061-4e3befa4ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:14.341419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1538065-b4a3-484c-b061-4e3befa4ff00 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:14.341734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1538065-b4a3-484c-b061-4e3befa4ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:14.342008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1538065-b4a3-484c-b061-4e3befa4ff00 None admin] PATH_INFO: `/v3/projects/f23dc36a79354b458faadbe1a6e3b118` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.344429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1538065-b4a3-484c-b061-4e3befa4ff00 None admin] RBAC: Authorizing `identity:get_project(project_id=f23dc36a79354b458faadbe1a6e3b118)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:14.346611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1538065-b4a3-484c-b061-4e3befa4ff00 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:14.348400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 99/191] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:14 2022] GET /identity/v3/projects/f23dc36a79354b458faadbe1a6e3b118 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:14.349210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1538065-b4a3-484c-b061-4e3befa4ff00 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:14.364646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:14.385608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47295023-106f-4a92-a953-51916a39c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:14.386258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47295023-106f-4a92-a953-51916a39c70a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:14.386528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47295023-106f-4a92-a953-51916a39c70a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:14.386796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47295023-106f-4a92-a953-51916a39c70a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.408531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47295023-106f-4a92-a953-51916a39c70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-47295023-106f-4a92-a953-51916a39c70a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:14.413480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:14.414448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:14.415225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 93/192] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:14.415919 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47295023-106f-4a92-a953-51916a39c70a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:14.481087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1538065-b4a3-484c-b061-4e3befa4ff00 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:14.503395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:14.520123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701551d-1a27-47f7-aa1f-0af20f573feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:14.520804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701551d-1a27-47f7-aa1f-0af20f573feb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:14.521086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701551d-1a27-47f7-aa1f-0af20f573feb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:14.521359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701551d-1a27-47f7-aa1f-0af20f573feb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.522501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701551d-1a27-47f7-aa1f-0af20f573feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:14.523998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701551d-1a27-47f7-aa1f-0af20f573feb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:14.525596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 100/193] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:14.527584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701551d-1a27-47f7-aa1f-0af20f573feb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:14.543578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47295023-106f-4a92-a953-51916a39c70a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:14.588163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4adb6-4887-4e55-8817-ea14337b435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:14.589151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4adb6-4887-4e55-8817-ea14337b435c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:14.589427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4adb6-4887-4e55-8817-ea14337b435c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:14.589692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4adb6-4887-4e55-8817-ea14337b435c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.617217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:14.639918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701551d-1a27-47f7-aa1f-0af20f573feb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:14.670052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4adb6-4887-4e55-8817-ea14337b435c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:14.671541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4adb6-4887-4e55-8817-ea14337b435c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:14.676735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2a47d-a5bc-4a44-9f71-83b3d1784b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:14.677594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2a47d-a5bc-4a44-9f71-83b3d1784b2e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:14.677869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2a47d-a5bc-4a44-9f71-83b3d1784b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:14.678145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2a47d-a5bc-4a44-9f71-83b3d1784b2e None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.678810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2a47d-a5bc-4a44-9f71-83b3d1784b2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:14.679108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2a47d-a5bc-4a44-9f71-83b3d1784b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:14.680537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2a47d-a5bc-4a44-9f71-83b3d1784b2e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:14.690780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 101/194] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:14.690780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2a47d-a5bc-4a44-9f71-83b3d1784b2e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:14.761776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:14.794284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2a47d-a5bc-4a44-9f71-83b3d1784b2e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:14.795662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 94/195] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:14.796557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4adb6-4887-4e55-8817-ea14337b435c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:14.843041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9cf6-a481-4235-ba5f-a972a15d0bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:14.843666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9cf6-a481-4235-ba5f-a972a15d0bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:14.843841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9cf6-a481-4235-ba5f-a972a15d0bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:14.844120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9cf6-a481-4235-ba5f-a972a15d0bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.844853 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d9cf6-a481-4235-ba5f-a972a15d0bf2 None admin] RBAC: Adding query filter params (role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=f23dc36a79354b458faadbe1a6e3b118, user.id=732cad40509a4bc799b9ef3a107f5645) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:14.845786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d9cf6-a481-4235-ba5f-a972a15d0bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:14.853962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d9cf6-a481-4235-ba5f-a972a15d0bf2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:14.875780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 102/196] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:14 2022] GET /identity/v3/role_assignments?user.id=732cad40509a4bc799b9ef3a107f5645&scope.project.id=f23dc36a79354b458faadbe1a6e3b118&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:14.875780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9cf6-a481-4235-ba5f-a972a15d0bf2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:14.881545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:14.918143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4adb6-4887-4e55-8817-ea14337b435c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:14.968467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a5e08-3dcf-4743-9537-a91d7fe00dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:14.969112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5e08-3dcf-4743-9537-a91d7fe00dde None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:14.969393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5e08-3dcf-4743-9537-a91d7fe00dde None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:14.969666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5e08-3dcf-4743-9537-a91d7fe00dde None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:14.970363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a5e08-3dcf-4743-9537-a91d7fe00dde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:14.971303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a5e08-3dcf-4743-9537-a91d7fe00dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:14.973245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a5e08-3dcf-4743-9537-a91d7fe00dde None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:14.988010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 95/197] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:14.993095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a5e08-3dcf-4743-9537-a91d7fe00dde None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:15.029965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:15.031544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9cf6-a481-4235-ba5f-a972a15d0bf2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:15.078543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929dffb-c07c-4a33-8e57-2fcd2081a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:15.079155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929dffb-c07c-4a33-8e57-2fcd2081a7a3 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:15.079426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929dffb-c07c-4a33-8e57-2fcd2081a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:15.079692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929dffb-c07c-4a33-8e57-2fcd2081a7a3 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:15.081180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929dffb-c07c-4a33-8e57-2fcd2081a7a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:15.082673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929dffb-c07c-4a33-8e57-2fcd2081a7a3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:15.126269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a5e08-3dcf-4743-9537-a91d7fe00dde None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:15.162079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb2ef4-bf97-43d8-ac43-4275384a7b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:15.162710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb2ef4-bf97-43d8-ac43-4275384a7b5c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:15.163013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb2ef4-bf97-43d8-ac43-4275384a7b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:15.163292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb2ef4-bf97-43d8-ac43-4275384a7b5c None admin] PATH_INFO: `/v3/users/e2b0b629e6ab46148f89bd99cce01ad6` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:15.164399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb2ef4-bf97-43d8-ac43-4275384a7b5c None admin] RBAC: Authorizing `identity:get_user(user_id=e2b0b629e6ab46148f89bd99cce01ad6)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:15.165848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb2ef4-bf97-43d8-ac43-4275384a7b5c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:15.167687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 96/198] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:14 2022] GET /identity/v3/users/e2b0b629e6ab46148f89bd99cce01ad6 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:15.168465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb2ef4-bf97-43d8-ac43-4275384a7b5c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:15.178077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 103/199] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:58:14 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:15.178915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929dffb-c07c-4a33-8e57-2fcd2081a7a3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:15.251971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:15.321118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:15.322546 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929dffb-c07c-4a33-8e57-2fcd2081a7a3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:15.328002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb2ef4-bf97-43d8-ac43-4275384a7b5c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:15.377644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f498fab-3c9e-4b70-b1a0-3467161f5daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:15.378600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f498fab-3c9e-4b70-b1a0-3467161f5daf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:15.379318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f498fab-3c9e-4b70-b1a0-3467161f5daf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:15.379318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f498fab-3c9e-4b70-b1a0-3467161f5daf None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:15.380555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f498fab-3c9e-4b70-b1a0-3467161f5daf None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:15.382019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f498fab-3c9e-4b70-b1a0-3467161f5daf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:15.383952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 97/200] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:15 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:15.384889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f498fab-3c9e-4b70-b1a0-3467161f5daf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:15.386567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee112f9a-7cdd-474b-a751-80ce24ef695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:15.387162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112f9a-7cdd-474b-a751-80ce24ef695b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:15.387437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112f9a-7cdd-474b-a751-80ce24ef695b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:15.388013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112f9a-7cdd-474b-a751-80ce24ef695b None admin] PATH_INFO: `/v3/users/845409167b5c4bb39ad95ad4156ae970` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:15.390101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee112f9a-7cdd-474b-a751-80ce24ef695b None admin] RBAC: Authorizing `identity:get_user(user_id=845409167b5c4bb39ad95ad4156ae970)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:15.391570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee112f9a-7cdd-474b-a751-80ce24ef695b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:15.393717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 104/201] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:15 2022] GET /identity/v3/users/845409167b5c4bb39ad95ad4156ae970 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:15.394956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee112f9a-7cdd-474b-a751-80ce24ef695b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:15.519384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f498fab-3c9e-4b70-b1a0-3467161f5daf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:15.546664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee112f9a-7cdd-474b-a751-80ce24ef695b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:15.567109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca17fe7-eb1d-463d-8a39-f828797ea9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:15.569084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca17fe7-eb1d-463d-8a39-f828797ea9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:15.569084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca17fe7-eb1d-463d-8a39-f828797ea9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:15.570224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca17fe7-eb1d-463d-8a39-f828797ea9a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:15.592701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:15.610788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fcfa4-28d5-4146-b780-106ea5ab06d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:15.613156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fcfa4-28d5-4146-b780-106ea5ab06d1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:15.613663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fcfa4-28d5-4146-b780-106ea5ab06d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:15.614080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fcfa4-28d5-4146-b780-106ea5ab06d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:15.615013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fcfa4-28d5-4146-b780-106ea5ab06d1 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe, user.id=845409167b5c4bb39ad95ad4156ae970) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:15.616213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fcfa4-28d5-4146-b780-106ea5ab06d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:15.618114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fcfa4-28d5-4146-b780-106ea5ab06d1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:15.629576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 105/202] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:15 2022] GET /identity/v3/role_assignments?user.id=845409167b5c4bb39ad95ad4156ae970&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=55aed406476a485f99f9815f9f27cb3b => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:15.630852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fcfa4-28d5-4146-b780-106ea5ab06d1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:15.638441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:15.768992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca17fe7-eb1d-463d-8a39-f828797ea9a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:15.771501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca17fe7-eb1d-463d-8a39-f828797ea9a5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:15.816905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fcfa4-28d5-4146-b780-106ea5ab06d1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:15.868522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a6cb0-d6d2-4b85-9be9-f23578e2fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:15.869535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a6cb0-d6d2-4b85-9be9-f23578e2fad7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:15.869535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a6cb0-d6d2-4b85-9be9-f23578e2fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:15.869771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a6cb0-d6d2-4b85-9be9-f23578e2fad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:15.942746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:15.949325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 98/203] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:15.955015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a6cb0-d6d2-4b85-9be9-f23578e2fad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:15.959087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca17fe7-eb1d-463d-8a39-f828797ea9a5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:15.959219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a6cb0-d6d2-4b85-9be9-f23578e2fad7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:16.094306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:16.131851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 106/204] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:16.137490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a6cb0-d6d2-4b85-9be9-f23578e2fad7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:16.225986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca17fe7-eb1d-463d-8a39-f828797ea9a5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:16.260480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:16.271983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a6cb0-d6d2-4b85-9be9-f23578e2fad7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:16.318372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf6b8b-303c-4243-b066-eccf0e9fdcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:16.319035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf6b8b-303c-4243-b066-eccf0e9fdcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:16.319315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf6b8b-303c-4243-b066-eccf0e9fdcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:16.319588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf6b8b-303c-4243-b066-eccf0e9fdcb6 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:16.322596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c1dde-d87b-47d7-8dc4-2484d00309e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:16.323243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c1dde-d87b-47d7-8dc4-2484d00309e4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:16.323521 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c1dde-d87b-47d7-8dc4-2484d00309e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:16.323816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c1dde-d87b-47d7-8dc4-2484d00309e4 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:16.325031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf6b8b-303c-4243-b066-eccf0e9fdcb6 None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:16.326515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf6b8b-303c-4243-b066-eccf0e9fdcb6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:16.328469 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 99/205] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:15 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:16.328956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c1dde-d87b-47d7-8dc4-2484d00309e4 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:16.331164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c1dde-d87b-47d7-8dc4-2484d00309e4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:16.333153 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 107/206] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:16 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:16.335224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf6b8b-303c-4243-b066-eccf0e9fdcb6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:16.338748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c1dde-d87b-47d7-8dc4-2484d00309e4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:16.521433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf6b8b-303c-4243-b066-eccf0e9fdcb6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:16.556641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c1dde-d87b-47d7-8dc4-2484d00309e4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:16.596810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e7fdb-39e0-40fb-816f-7407f50a968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:16.597766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7fdb-39e0-40fb-816f-7407f50a968d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:16.598238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7fdb-39e0-40fb-816f-7407f50a968d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:16.598701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e7fdb-39e0-40fb-816f-7407f50a968d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:16.599841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7fdb-39e0-40fb-816f-7407f50a968d None admin] RBAC: Adding query filter params (role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe, user.id=845409167b5c4bb39ad95ad4156ae970) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:16.600388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7fdb-39e0-40fb-816f-7407f50a968d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:16.602083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e7fdb-39e0-40fb-816f-7407f50a968d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:16.608627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 108/207] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:16 2022] GET /identity/v3/role_assignments?user.id=845409167b5c4bb39ad95ad4156ae970&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:16.618806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bacbb-dcb3-483c-98ae-4fdfcfdebe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:16.619441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bacbb-dcb3-483c-98ae-4fdfcfdebe6e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:16.619719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bacbb-dcb3-483c-98ae-4fdfcfdebe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:16.620016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bacbb-dcb3-483c-98ae-4fdfcfdebe6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:16.620763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bacbb-dcb3-483c-98ae-4fdfcfdebe6e None admin] RBAC: Adding query filter params (role.id=59ee78b0895446c0b5244158b1252b64, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc, user.id=e2b0b629e6ab46148f89bd99cce01ad6) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:16.621070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bacbb-dcb3-483c-98ae-4fdfcfdebe6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:16.622581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bacbb-dcb3-483c-98ae-4fdfcfdebe6e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:16.633534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:16.637128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 100/208] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:16 2022] GET /identity/v3/role_assignments?user.id=e2b0b629e6ab46148f89bd99cce01ad6&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=59ee78b0895446c0b5244158b1252b64 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:17.622150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920f03b-b2b3-4c8a-b503-12055f2edb77 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:17.623042 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920f03b-b2b3-4c8a-b503-12055f2edb77 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:17.623462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920f03b-b2b3-4c8a-b503-12055f2edb77 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:17.625265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 109/209] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:17.631187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6aed-2473-4e42-beae-7254c4de9309 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:17.632156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6aed-2473-4e42-beae-7254c4de9309 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:17.632668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6aed-2473-4e42-beae-7254c4de9309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:17.652942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-54ed6aed-2473-4e42-beae-7254c4de9309 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:17.654535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-54ed6aed-2473-4e42-beae-7254c4de9309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:17.732516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 101/210] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:17.856053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba02760-8644-419e-a3ca-ca2499911994 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:17.856505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba02760-8644-419e-a3ca-ca2499911994 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:17.856883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba02760-8644-419e-a3ca-ca2499911994 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:17.858607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 110/211] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:17.864965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf3e68-abca-4ae5-9f71-b2dcbc836a78 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:17.865335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf3e68-abca-4ae5-9f71-b2dcbc836a78 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:17.865689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf3e68-abca-4ae5-9f71-b2dcbc836a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:17.876533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953a671-b9f0-4030-b79f-f6f238d98f89 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:17.876764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953a671-b9f0-4030-b79f-f6f238d98f89 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:17.877031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953a671-b9f0-4030-b79f-f6f238d98f89 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:17.878692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 111/212] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:17.884324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fcaea-e88e-4d86-b79f-5c1d98851429 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:17.884656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fcaea-e88e-4d86-b79f-5c1d98851429 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:17.884865 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fcaea-e88e-4d86-b79f-5c1d98851429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:17.886252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b7cf3e68-abca-4ae5-9f71-b2dcbc836a78 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:17.887490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b7cf3e68-abca-4ae5-9f71-b2dcbc836a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:17.904272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-da7fcaea-e88e-4d86-b79f-5c1d98851429 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:17.905485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-da7fcaea-e88e-4d86-b79f-5c1d98851429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:17.929367 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:17.976755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 102/213] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:18.003894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 112/214] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:18.040849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf3e68-abca-4ae5-9f71-b2dcbc836a78 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:18.109383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:18.152731 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf3e68-abca-4ae5-9f71-b2dcbc836a78 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:18.203118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877fc70-5ddd-4ec5-8425-dcd9163e08f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:18.203773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877fc70-5ddd-4ec5-8425-dcd9163e08f7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:18.204051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877fc70-5ddd-4ec5-8425-dcd9163e08f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:18.204319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877fc70-5ddd-4ec5-8425-dcd9163e08f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:18.217097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877fc70-5ddd-4ec5-8425-dcd9163e08f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f877fc70-5ddd-4ec5-8425-dcd9163e08f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:18.223346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:18.224279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:18.225118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 103/215] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:18.237335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fcaea-e88e-4d86-b79f-5c1d98851429 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:18.265461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877fc70-5ddd-4ec5-8425-dcd9163e08f7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:18.382325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fcaea-e88e-4d86-b79f-5c1d98851429 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:18.409752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877fc70-5ddd-4ec5-8425-dcd9163e08f7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:18.421448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6312a-59fc-465f-83e1-0d060099ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:18.422070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6312a-59fc-465f-83e1-0d060099ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:18.422348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6312a-59fc-465f-83e1-0d060099ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:18.422618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6312a-59fc-465f-83e1-0d060099ebf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:18.423288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6312a-59fc-465f-83e1-0d060099ebf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:18.423986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6312a-59fc-465f-83e1-0d060099ebf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:18.425697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6312a-59fc-465f-83e1-0d060099ebf2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:18.434528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:18.434868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 113/216] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:18.435704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6312a-59fc-465f-83e1-0d060099ebf2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:18.454636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703de87-8223-46e4-9b09-725269833a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:18.459985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703de87-8223-46e4-9b09-725269833a5f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:18.459985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703de87-8223-46e4-9b09-725269833a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:18.460214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:18.460290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703de87-8223-46e4-9b09-725269833a5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:18.460290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703de87-8223-46e4-9b09-725269833a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:18.460290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703de87-8223-46e4-9b09-725269833a5f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:18.460760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 104/217] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:18.466029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703de87-8223-46e4-9b09-725269833a5f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:18.571402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6312a-59fc-465f-83e1-0d060099ebf2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:18.593149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703de87-8223-46e4-9b09-725269833a5f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:18.617776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797817a-00fa-438f-bb25-1a28176adcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:18.618412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797817a-00fa-438f-bb25-1a28176adcae None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:18.618693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797817a-00fa-438f-bb25-1a28176adcae None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:18.618960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797817a-00fa-438f-bb25-1a28176adcae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:18.632542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797817a-00fa-438f-bb25-1a28176adcae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:18.633920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fb53c-c790-4b75-bc1c-28398f7e4b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:18.637505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fb53c-c790-4b75-bc1c-28398f7e4b3d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:18.637505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fb53c-c790-4b75-bc1c-28398f7e4b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:18.637505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fb53c-c790-4b75-bc1c-28398f7e4b3d None admin] PATH_INFO: `/v3/users/d0d4f1a32f46423aa1e70a5d13c952c9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a797817a-00fa-438f-bb25-1a28176adcae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:18.638221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:18.639951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 114/218] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:18.640826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797817a-00fa-438f-bb25-1a28176adcae None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:18.652181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fb53c-c790-4b75-bc1c-28398f7e4b3d None admin] RBAC: Authorizing `identity:get_user(user_id=d0d4f1a32f46423aa1e70a5d13c952c9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:18.653646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fb53c-c790-4b75-bc1c-28398f7e4b3d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:18.655349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 105/219] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:18 2022] GET /identity/v3/users/d0d4f1a32f46423aa1e70a5d13c952c9 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:18.656160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fb53c-c790-4b75-bc1c-28398f7e4b3d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:18.712300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:18.744172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:18.769484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797817a-00fa-438f-bb25-1a28176adcae None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:18.778689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fb53c-c790-4b75-bc1c-28398f7e4b3d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:18.811113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff015eae-80ee-46bc-88e7-a700c5ab1153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:18.811720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff015eae-80ee-46bc-88e7-a700c5ab1153 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:18.812024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff015eae-80ee-46bc-88e7-a700c5ab1153 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:18.812290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff015eae-80ee-46bc-88e7-a700c5ab1153 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:18.812942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff015eae-80ee-46bc-88e7-a700c5ab1153 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:18.814398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff015eae-80ee-46bc-88e7-a700c5ab1153 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:18.817549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31fe4a-5a83-4864-bb95-7838424ad9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:18.818158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31fe4a-5a83-4864-bb95-7838424ad9fd None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:18.818433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31fe4a-5a83-4864-bb95-7838424ad9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:18.818699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31fe4a-5a83-4864-bb95-7838424ad9fd None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:18.819359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31fe4a-5a83-4864-bb95-7838424ad9fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:18.819655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31fe4a-5a83-4864-bb95-7838424ad9fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:18.821068 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31fe4a-5a83-4864-bb95-7838424ad9fd None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:18.829721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 106/220] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:18.830866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31fe4a-5a83-4864-bb95-7838424ad9fd None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:18.906053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 115/221] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:58:18 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:18.912448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8299aaa-6ebc-4c74-9229-f1a70616b88c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:18.912808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8299aaa-6ebc-4c74-9229-f1a70616b88c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:18.913050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8299aaa-6ebc-4c74-9229-f1a70616b88c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:18.914947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 116/222] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:18.915842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8299aaa-6ebc-4c74-9229-f1a70616b88c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:18.956463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31fe4a-5a83-4864-bb95-7838424ad9fd None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:18.967145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:19.008499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a6806-38c6-4280-bcc6-9f47516b3454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:19.009458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a6806-38c6-4280-bcc6-9f47516b3454 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:19.009934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a6806-38c6-4280-bcc6-9f47516b3454 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:19.010405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a6806-38c6-4280-bcc6-9f47516b3454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:19.060036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8299aaa-6ebc-4c74-9229-f1a70616b88c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:19.102870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a6806-38c6-4280-bcc6-9f47516b3454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:19.105992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a6806-38c6-4280-bcc6-9f47516b3454 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:19.115583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:19.122068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890b61f-35cc-412a-b236-efbe589cfbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:19.134314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890b61f-35cc-412a-b236-efbe589cfbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:19.134314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890b61f-35cc-412a-b236-efbe589cfbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:19.134314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890b61f-35cc-412a-b236-efbe589cfbb8 None admin] PATH_INFO: `/v3/users/845409167b5c4bb39ad95ad4156ae970` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:19.134314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890b61f-35cc-412a-b236-efbe589cfbb8 None admin] RBAC: Authorizing `identity:get_user(user_id=845409167b5c4bb39ad95ad4156ae970)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:19.134314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890b61f-35cc-412a-b236-efbe589cfbb8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:19.134314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 117/223] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:18 2022] GET /identity/v3/users/845409167b5c4bb39ad95ad4156ae970 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:19.134758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c16c5-59a9-4062-8fbe-60a112f043bd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:19.134758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c16c5-59a9-4062-8fbe-60a112f043bd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:19.134758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c16c5-59a9-4062-8fbe-60a112f043bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:19.148988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b70c16c5-59a9-4062-8fbe-60a112f043bd None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:19.150458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b70c16c5-59a9-4062-8fbe-60a112f043bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:19.238060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 118/224] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:19.239199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c16c5-59a9-4062-8fbe-60a112f043bd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:19.244317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 107/225] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:19.253094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a6806-38c6-4280-bcc6-9f47516b3454 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:19.265527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:19.398298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c16c5-59a9-4062-8fbe-60a112f043bd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:19.431786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a6806-38c6-4280-bcc6-9f47516b3454 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:19.448131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:19.463077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb2827-0563-4168-bbcb-cb1887d59ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:19.464093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb2827-0563-4168-bbcb-cb1887d59ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:19.464525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb2827-0563-4168-bbcb-cb1887d59ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:19.464983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb2827-0563-4168-bbcb-cb1887d59ba0 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:19.472123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb2827-0563-4168-bbcb-cb1887d59ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:19.475109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb2827-0563-4168-bbcb-cb1887d59ba0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:19.484397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 119/226] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:19 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:19.489527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb2827-0563-4168-bbcb-cb1887d59ba0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:19.536292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cef0a-8773-4173-b515-83de30080c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:19.537681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cef0a-8773-4173-b515-83de30080c3d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:19.538136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cef0a-8773-4173-b515-83de30080c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:19.538552 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cef0a-8773-4173-b515-83de30080c3d None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:19.540729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cef0a-8773-4173-b515-83de30080c3d None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:19.543864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cef0a-8773-4173-b515-83de30080c3d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:19.555771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 108/227] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:19 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:19.559262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cef0a-8773-4173-b515-83de30080c3d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:19.671049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:19.672865 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb2827-0563-4168-bbcb-cb1887d59ba0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:19.697123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cef0a-8773-4173-b515-83de30080c3d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:19.727074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b4ec4-0ed0-467c-a825-786ee20f4df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:19.728159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b4ec4-0ed0-467c-a825-786ee20f4df9 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:19.728656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b4ec4-0ed0-467c-a825-786ee20f4df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:19.729121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b4ec4-0ed0-467c-a825-786ee20f4df9 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/users/845409167b5c4bb39ad95ad4156ae970/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:19.731317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b4ec4-0ed0-467c-a825-786ee20f4df9 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ee0bb518b41478ab6403f510bfebe, user_id=845409167b5c4bb39ad95ad4156ae970, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:19.733147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b4ec4-0ed0-467c-a825-786ee20f4df9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:19.738937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b2155-66c8-4a11-b338-70dd61cf77fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:19.739791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b2155-66c8-4a11-b338-70dd61cf77fe None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:19.740057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b2155-66c8-4a11-b338-70dd61cf77fe None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:19.740331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b2155-66c8-4a11-b338-70dd61cf77fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:19.741101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b2155-66c8-4a11-b338-70dd61cf77fe None admin] RBAC: Adding query filter params (role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe, user.id=d0d4f1a32f46423aa1e70a5d13c952c9) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:19.741413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b2155-66c8-4a11-b338-70dd61cf77fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:19.742876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b2155-66c8-4a11-b338-70dd61cf77fe None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:19.749090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 109/228] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:19 2022] GET /identity/v3/role_assignments?user.id=d0d4f1a32f46423aa1e70a5d13c952c9&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:19.749940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b2155-66c8-4a11-b338-70dd61cf77fe None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:19.831517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 120/229] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:58:19 2022] PUT /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/users/845409167b5c4bb39ad95ad4156ae970/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:19.905892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b2155-66c8-4a11-b338-70dd61cf77fe None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:19.961798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbaa4-fa35-4bc6-94d4-94abf1e037d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:19.962533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbaa4-fa35-4bc6-94d4-94abf1e037d9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:19.962816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbaa4-fa35-4bc6-94d4-94abf1e037d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:19.963088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbaa4-fa35-4bc6-94d4-94abf1e037d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:19.974629 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:19.978527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fbaa4-fa35-4bc6-94d4-94abf1e037d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-bd0fbaa4-fa35-4bc6-94d4-94abf1e037d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:19.983730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:19.988995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:19.989770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 110/230] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:19.992910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b4ec4-0ed0-467c-a825-786ee20f4df9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:20.083596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:20.130190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b4ec4-0ed0-467c-a825-786ee20f4df9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:20.167500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff9fb-b8b3-4393-8f59-107af4882ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:20.168275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff9fb-b8b3-4393-8f59-107af4882ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:20.168555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff9fb-b8b3-4393-8f59-107af4882ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:20.168823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff9fb-b8b3-4393-8f59-107af4882ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:20.169499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff9fb-b8b3-4393-8f59-107af4882ee9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:20.169840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff9fb-b8b3-4393-8f59-107af4882ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:20.171228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff9fb-b8b3-4393-8f59-107af4882ee9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:20.181065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 121/231] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:20.190603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbaa4-fa35-4bc6-94d4-94abf1e037d9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:20.365386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbaa4-fa35-4bc6-94d4-94abf1e037d9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:20.428514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cf46-804d-4090-9826-065ba6254924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:20.429542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cf46-804d-4090-9826-065ba6254924 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:20.430028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cf46-804d-4090-9826-065ba6254924 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:20.430496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cf46-804d-4090-9826-065ba6254924 None admin] PATH_INFO: `/v3/users/845409167b5c4bb39ad95ad4156ae970` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:20.431968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23cf46-804d-4090-9826-065ba6254924 None admin] RBAC: Authorizing `identity:get_user(user_id=845409167b5c4bb39ad95ad4156ae970)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:20.433640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23cf46-804d-4090-9826-065ba6254924 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:20.435605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 111/232] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:20 2022] GET /identity/v3/users/845409167b5c4bb39ad95ad4156ae970 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:20.444945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff9fb-b8b3-4393-8f59-107af4882ee9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:20.657338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff9fb-b8b3-4393-8f59-107af4882ee9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:20.693686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:20.725338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0d336-d890-4d36-b250-6ca21bc1bfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:20.725991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d336-d890-4d36-b250-6ca21bc1bfbe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:20.726270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d336-d890-4d36-b250-6ca21bc1bfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:20.726542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0d336-d890-4d36-b250-6ca21bc1bfbe None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:20.728496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0d336-d890-4d36-b250-6ca21bc1bfbe None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:20.730230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0d336-d890-4d36-b250-6ca21bc1bfbe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:20.732470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 122/233] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:20 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:20.738807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cf46-804d-4090-9826-065ba6254924 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:20.852820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:20.891443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cf46-804d-4090-9826-065ba6254924 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:20.942107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a894a39-1a33-4f08-bc95-5022e156bfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:20.943088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a894a39-1a33-4f08-bc95-5022e156bfaf None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:20.943422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a894a39-1a33-4f08-bc95-5022e156bfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:20.943702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a894a39-1a33-4f08-bc95-5022e156bfaf None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/users/845409167b5c4bb39ad95ad4156ae970/roles/ff90bae50e0644739e4bdec7431da2e0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:20.946372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a894a39-1a33-4f08-bc95-5022e156bfaf None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ee0bb518b41478ab6403f510bfebe, user_id=845409167b5c4bb39ad95ad4156ae970, role_id=ff90bae50e0644739e4bdec7431da2e0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:20.948031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a894a39-1a33-4f08-bc95-5022e156bfaf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:21.080793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 112/234] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:58:20 2022] PUT /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/users/845409167b5c4bb39ad95ad4156ae970/roles/ff90bae50e0644739e4bdec7431da2e0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:58:21.516047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2d87-8dcf-4fcf-8ada-942aefeabce2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:21.516441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2d87-8dcf-4fcf-8ada-942aefeabce2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:21.516614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2d87-8dcf-4fcf-8ada-942aefeabce2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:21.519387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 123/235] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:21.524700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120e908-f27d-454f-a992-a0648e3e2dca None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:21.524987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120e908-f27d-454f-a992-a0648e3e2dca None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:21.525271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120e908-f27d-454f-a992-a0648e3e2dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:21.549102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d120e908-f27d-454f-a992-a0648e3e2dca None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:21.551205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d120e908-f27d-454f-a992-a0648e3e2dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:21.597337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1570f8f-020d-4897-bdac-28aab0ba4e98 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:21.597666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1570f8f-020d-4897-bdac-28aab0ba4e98 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:21.597890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1570f8f-020d-4897-bdac-28aab0ba4e98 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:21.599997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 124/236] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:21.611280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15b602-4ca8-4d14-af1c-268bba4c107c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:21.611738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15b602-4ca8-4d14-af1c-268bba4c107c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:21.612256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15b602-4ca8-4d14-af1c-268bba4c107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:21.638607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 113/237] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:21.661371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0d15b602-4ca8-4d14-af1c-268bba4c107c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:21.663334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0d15b602-4ca8-4d14-af1c-268bba4c107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:21.770355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 125/238] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:22.044536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120e908-f27d-454f-a992-a0648e3e2dca None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:22.119731 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:22.156871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15b602-4ca8-4d14-af1c-268bba4c107c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:22.179256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120e908-f27d-454f-a992-a0648e3e2dca None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:22.218178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d338c-4a09-4dd7-b410-e6f3e3b64db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:22.218825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d338c-4a09-4dd7-b410-e6f3e3b64db1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.219107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d338c-4a09-4dd7-b410-e6f3e3b64db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.219380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d338c-4a09-4dd7-b410-e6f3e3b64db1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.221136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d338c-4a09-4dd7-b410-e6f3e3b64db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:22.223149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d338c-4a09-4dd7-b410-e6f3e3b64db1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:22.225245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 114/239] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:22.234288 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d338c-4a09-4dd7-b410-e6f3e3b64db1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:22.342533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15b602-4ca8-4d14-af1c-268bba4c107c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:22.383661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:22.419248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c513e-53c4-4b89-aeb5-03ee9ced97c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:22.420025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c513e-53c4-4b89-aeb5-03ee9ced97c2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.420207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c513e-53c4-4b89-aeb5-03ee9ced97c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.421707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c513e-53c4-4b89-aeb5-03ee9ced97c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.432370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c513e-53c4-4b89-aeb5-03ee9ced97c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0d8c513e-53c4-4b89-aeb5-03ee9ced97c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:22.437927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:22.440056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:22.441471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 126/240] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:22.453576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c513e-53c4-4b89-aeb5-03ee9ced97c2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:22.477044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d338c-4a09-4dd7-b410-e6f3e3b64db1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:22.529943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:22.544358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc0f7b-0339-4777-ae77-a8486c4c9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:22.556884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0f7b-0339-4777-ae77-a8486c4c9bca None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.556884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0f7b-0339-4777-ae77-a8486c4c9bca None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.556884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0f7b-0339-4777-ae77-a8486c4c9bca None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.556884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc0f7b-0339-4777-ae77-a8486c4c9bca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:22.556884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc0f7b-0339-4777-ae77-a8486c4c9bca None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:22.620880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 115/241] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:58:22 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:22.623395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fba7bc-fae4-4b27-9f1e-c887ffd86fd3 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.624677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fba7bc-fae4-4b27-9f1e-c887ffd86fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.625350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fba7bc-fae4-4b27-9f1e-c887ffd86fd3 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.630439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 116/242] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:22.637167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02559ab6-9869-4424-81c7-0ec0f8e5f925 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.637455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02559ab6-9869-4424-81c7-0ec0f8e5f925 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.637702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02559ab6-9869-4424-81c7-0ec0f8e5f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.643092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c513e-53c4-4b89-aeb5-03ee9ced97c2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:22.691446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-02559ab6-9869-4424-81c7-0ec0f8e5f925 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:22.693870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-02559ab6-9869-4424-81c7-0ec0f8e5f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:22.723168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d9ac7-f01a-40a3-a426-2e9b49c25821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:22.724255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d9ac7-f01a-40a3-a426-2e9b49c25821 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.724714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d9ac7-f01a-40a3-a426-2e9b49c25821 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.725160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d9ac7-f01a-40a3-a426-2e9b49c25821 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.726854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d9ac7-f01a-40a3-a426-2e9b49c25821 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:22.727403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d9ac7-f01a-40a3-a426-2e9b49c25821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:22.729945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d9ac7-f01a-40a3-a426-2e9b49c25821 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:22.747935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 127/243] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:22.751250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b9da-1284-472d-8a00-b84a07db08fb None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.752444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b9da-1284-472d-8a00-b84a07db08fb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.752941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b9da-1284-472d-8a00-b84a07db08fb None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.754558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 128/244] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:22.755698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b9da-1284-472d-8a00-b84a07db08fb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:22.797505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 117/245] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:22.797505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ddfa-f647-4e3c-b850-ebbaafc0ac81 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.797505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ddfa-f647-4e3c-b850-ebbaafc0ac81 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.797505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ddfa-f647-4e3c-b850-ebbaafc0ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.819635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9352ddfa-f647-4e3c-b850-ebbaafc0ac81 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:22.821133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9352ddfa-f647-4e3c-b850-ebbaafc0ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:22.836132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:22.900558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b9da-1284-472d-8a00-b84a07db08fb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:22.928174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 118/246] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:22.943842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a402b-ca42-4a5c-8afd-b89ebf25c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:22.944547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a402b-ca42-4a5c-8afd-b89ebf25c27b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:22.944820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a402b-ca42-4a5c-8afd-b89ebf25c27b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:22.945145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a402b-ca42-4a5c-8afd-b89ebf25c27b None admin] PATH_INFO: `/v3/users/ec1ffbf9b1324bec962cad1e21e2960c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:22.964345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a402b-ca42-4a5c-8afd-b89ebf25c27b None admin] RBAC: Authorizing `identity:get_user(user_id=ec1ffbf9b1324bec962cad1e21e2960c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:22.965876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a402b-ca42-4a5c-8afd-b89ebf25c27b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:22.971877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 129/247] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:22 2022] GET /identity/v3/users/ec1ffbf9b1324bec962cad1e21e2960c => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:22.975189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ddfa-f647-4e3c-b850-ebbaafc0ac81 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:23.031123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:23.094914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a402b-ca42-4a5c-8afd-b89ebf25c27b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:23.114534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ddfa-f647-4e3c-b850-ebbaafc0ac81 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:23.168790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d336ef7-a571-4969-bed5-4f7f51dd4817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:23.169511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d336ef7-a571-4969-bed5-4f7f51dd4817 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.169892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d336ef7-a571-4969-bed5-4f7f51dd4817 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.170313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d336ef7-a571-4969-bed5-4f7f51dd4817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.259777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:23.267173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a402b-ca42-4a5c-8afd-b89ebf25c27b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:23.267431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d336ef7-a571-4969-bed5-4f7f51dd4817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:23.270079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d336ef7-a571-4969-bed5-4f7f51dd4817 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:23.316652 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266aa05-51ec-431d-b44e-e59da55c3a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:23.317720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266aa05-51ec-431d-b44e-e59da55c3a47 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.318184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266aa05-51ec-431d-b44e-e59da55c3a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.318643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266aa05-51ec-431d-b44e-e59da55c3a47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.328064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:23.339518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266aa05-51ec-431d-b44e-e59da55c3a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a266aa05-51ec-431d-b44e-e59da55c3a47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:23.345066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:23.346182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:23.347226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:23.347874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 130/248] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:23.348495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266aa05-51ec-431d-b44e-e59da55c3a47 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:23.432556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 119/249] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:23.434307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d336ef7-a571-4969-bed5-4f7f51dd4817 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:23.493445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266aa05-51ec-431d-b44e-e59da55c3a47 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:23.538809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9988f-25ed-47cc-a22c-6c219cf86a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:23.539465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9988f-25ed-47cc-a22c-6c219cf86a5e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.539762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9988f-25ed-47cc-a22c-6c219cf86a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.540037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9988f-25ed-47cc-a22c-6c219cf86a5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.553626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9988f-25ed-47cc-a22c-6c219cf86a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-2ea9988f-25ed-47cc-a22c-6c219cf86a5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:23.559702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:23.560642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:23.561422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:23.569241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d336ef7-a571-4969-bed5-4f7f51dd4817 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:23.569407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 131/250] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:23.569929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9988f-25ed-47cc-a22c-6c219cf86a5e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:23.611260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46b6ec-9378-4a9f-979c-fb2ae212b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:23.612212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46b6ec-9378-4a9f-979c-fb2ae212b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.612345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:23.612430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46b6ec-9378-4a9f-979c-fb2ae212b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.612653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46b6ec-9378-4a9f-979c-fb2ae212b9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.613341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46b6ec-9378-4a9f-979c-fb2ae212b9f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:23.613653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46b6ec-9378-4a9f-979c-fb2ae212b9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:23.615045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46b6ec-9378-4a9f-979c-fb2ae212b9f7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:23.625484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 120/251] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:23.626675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46b6ec-9378-4a9f-979c-fb2ae212b9f7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:23.637476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:23.709964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9988f-25ed-47cc-a22c-6c219cf86a5e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:23.749855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dce27-3fd7-45d3-b957-1fdea768ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:23.751018 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dce27-3fd7-45d3-b957-1fdea768ef9f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.751375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dce27-3fd7-45d3-b957-1fdea768ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.751781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dce27-3fd7-45d3-b957-1fdea768ef9f None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.753905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dce27-3fd7-45d3-b957-1fdea768ef9f None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:23.756001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dce27-3fd7-45d3-b957-1fdea768ef9f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:23.758523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 132/252] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:23 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:23.759840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70783b-9556-453f-b3e5-abd32d10a0d1 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.760129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70783b-9556-453f-b3e5-abd32d10a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.760405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70783b-9556-453f-b3e5-abd32d10a0d1 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.761903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 133/253] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:23.762627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70783b-9556-453f-b3e5-abd32d10a0d1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:23.768366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46b6ec-9378-4a9f-979c-fb2ae212b9f7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:23.805735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534cee-c67f-49ea-8bed-19f167b712df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:23.806492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534cee-c67f-49ea-8bed-19f167b712df None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.806867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534cee-c67f-49ea-8bed-19f167b712df None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.807234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da534cee-c67f-49ea-8bed-19f167b712df None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.808057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534cee-c67f-49ea-8bed-19f167b712df None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:23.808425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534cee-c67f-49ea-8bed-19f167b712df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:23.809942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da534cee-c67f-49ea-8bed-19f167b712df None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:23.825964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 121/254] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:23.826967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534cee-c67f-49ea-8bed-19f167b712df None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:23.872085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:23.891913 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70783b-9556-453f-b3e5-abd32d10a0d1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:23.932623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d0eb7-636f-43f1-bee0-61df625a0fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:23.933377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d0eb7-636f-43f1-bee0-61df625a0fec None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.934090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d0eb7-636f-43f1-bee0-61df625a0fec None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.934090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d0eb7-636f-43f1-bee0-61df625a0fec None admin] PATH_INFO: `/v3/users/845409167b5c4bb39ad95ad4156ae970` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.934736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:23.935572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d0eb7-636f-43f1-bee0-61df625a0fec None admin] RBAC: Authorizing `identity:get_user(user_id=845409167b5c4bb39ad95ad4156ae970)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:23.937094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d0eb7-636f-43f1-bee0-61df625a0fec None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:23.944272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 134/255] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:23 2022] GET /identity/v3/users/845409167b5c4bb39ad95ad4156ae970 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:23.945636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd6e8-c803-444a-b78e-07ed7f7e69ab None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.946308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd6e8-c803-444a-b78e-07ed7f7e69ab None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.946308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd6e8-c803-444a-b78e-07ed7f7e69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.967770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b5fbd6e8-c803-444a-b78e-07ed7f7e69ab None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:23.968922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b5fbd6e8-c803-444a-b78e-07ed7f7e69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:23.978583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da534cee-c67f-49ea-8bed-19f167b712df None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:24.027013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f57b8b-dca2-4a61-bf67-aede529a9f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:24.027956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f57b8b-dca2-4a61-bf67-aede529a9f7e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:24.028410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f57b8b-dca2-4a61-bf67-aede529a9f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:24.028878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f57b8b-dca2-4a61-bf67-aede529a9f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:24.030073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f57b8b-dca2-4a61-bf67-aede529a9f7e None admin] RBAC: Adding query filter params (role.id=59ee78b0895446c0b5244158b1252b64, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe, user.id=ec1ffbf9b1324bec962cad1e21e2960c) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:24.030557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f57b8b-dca2-4a61-bf67-aede529a9f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:24.033478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f57b8b-dca2-4a61-bf67-aede529a9f7e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:24.040212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 122/256] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:23 2022] GET /identity/v3/role_assignments?user.id=ec1ffbf9b1324bec962cad1e21e2960c&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=59ee78b0895446c0b5244158b1252b64 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:24.041687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f57b8b-dca2-4a61-bf67-aede529a9f7e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:24.074992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 135/257] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:24.076262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd6e8-c803-444a-b78e-07ed7f7e69ab None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:24.253820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:24.277080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd6e8-c803-444a-b78e-07ed7f7e69ab None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:24.317989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f57b8b-dca2-4a61-bf67-aede529a9f7e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:24.320399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c71cb-bd35-4d49-b198-81d8391fb9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:24.322304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c71cb-bd35-4d49-b198-81d8391fb9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:24.322820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c71cb-bd35-4d49-b198-81d8391fb9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:24.323307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c71cb-bd35-4d49-b198-81d8391fb9f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:24.404166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:24.406091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c71cb-bd35-4d49-b198-81d8391fb9f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:24.407871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c71cb-bd35-4d49-b198-81d8391fb9f4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:24.418193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260dba2-8253-4443-af3d-c132b5e5fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:24.418480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260dba2-8253-4443-af3d-c132b5e5fb71 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:24.440293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260dba2-8253-4443-af3d-c132b5e5fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:24.440293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260dba2-8253-4443-af3d-c132b5e5fb71 None admin] PATH_INFO: `/v3/users/d0d4f1a32f46423aa1e70a5d13c952c9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:24.440293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260dba2-8253-4443-af3d-c132b5e5fb71 None admin] RBAC: Authorizing `identity:get_user(user_id=d0d4f1a32f46423aa1e70a5d13c952c9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:24.440293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260dba2-8253-4443-af3d-c132b5e5fb71 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:24.440293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 123/258] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:24 2022] GET /identity/v3/users/d0d4f1a32f46423aa1e70a5d13c952c9 => generated 297 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:24.446284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260dba2-8253-4443-af3d-c132b5e5fb71 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:24.522652 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:24.563659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 136/259] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:24.583355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c71cb-bd35-4d49-b198-81d8391fb9f4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:24.636762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260dba2-8253-4443-af3d-c132b5e5fb71 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:24.714643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6cb65-09e6-452b-a381-d4f1fa0e5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:24.715400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6cb65-09e6-452b-a381-d4f1fa0e5fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:24.715683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6cb65-09e6-452b-a381-d4f1fa0e5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:24.715979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6cb65-09e6-452b-a381-d4f1fa0e5fc6 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:24.719988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6cb65-09e6-452b-a381-d4f1fa0e5fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:24.722022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6cb65-09e6-452b-a381-d4f1fa0e5fc6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:24.723765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 124/260] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:24 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:24.731398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6cb65-09e6-452b-a381-d4f1fa0e5fc6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:24.757657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c71cb-bd35-4d49-b198-81d8391fb9f4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:24.829109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b91e7-3fee-4d0f-88e6-f0b44b5bebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:24.829914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b91e7-3fee-4d0f-88e6-f0b44b5bebc1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:24.830188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b91e7-3fee-4d0f-88e6-f0b44b5bebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:24.830464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b91e7-3fee-4d0f-88e6-f0b44b5bebc1 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:24.833170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b91e7-3fee-4d0f-88e6-f0b44b5bebc1 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:24.834711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b91e7-3fee-4d0f-88e6-f0b44b5bebc1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:24.836548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 137/261] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:24 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:24.841795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b91e7-3fee-4d0f-88e6-f0b44b5bebc1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:24.878056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:24.941591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6cb65-09e6-452b-a381-d4f1fa0e5fc6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:24.944135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:24.993390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885fa42-a316-4710-9b4d-7ac8295ec654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:24.994411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885fa42-a316-4710-9b4d-7ac8295ec654 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:24.994885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885fa42-a316-4710-9b4d-7ac8295ec654 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:24.995347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885fa42-a316-4710-9b4d-7ac8295ec654 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:25.008774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885fa42-a316-4710-9b4d-7ac8295ec654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a885fa42-a316-4710-9b4d-7ac8295ec654 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:25.014472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:25.015421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:25.016564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:25.019226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 125/262] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:25.020809 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885fa42-a316-4710-9b4d-7ac8295ec654 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:25.098265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b91e7-3fee-4d0f-88e6-f0b44b5bebc1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:25.131296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885fa42-a316-4710-9b4d-7ac8295ec654 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:25.172342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:25.187784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ac94-3e0b-44bf-a8c5-516991389f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:25.187784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ac94-3e0b-44bf-a8c5-516991389f6c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:25.187784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ac94-3e0b-44bf-a8c5-516991389f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:25.187784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ac94-3e0b-44bf-a8c5-516991389f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:25.189433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ac94-3e0b-44bf-a8c5-516991389f6c None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe, user.id=845409167b5c4bb39ad95ad4156ae970) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:25.189433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ac94-3e0b-44bf-a8c5-516991389f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:25.189631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ac94-3e0b-44bf-a8c5-516991389f6c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:25.202508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 126/263] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:25 2022] GET /identity/v3/role_assignments?user.id=845409167b5c4bb39ad95ad4156ae970&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=55aed406476a485f99f9815f9f27cb3b => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:25.203404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ac94-3e0b-44bf-a8c5-516991389f6c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:25.232620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0799ccd-4fb3-496a-a641-802bd3a0c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:25.233321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0799ccd-4fb3-496a-a641-802bd3a0c133 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:25.233606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0799ccd-4fb3-496a-a641-802bd3a0c133 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:25.233887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0799ccd-4fb3-496a-a641-802bd3a0c133 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/users/d0d4f1a32f46423aa1e70a5d13c952c9/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:25.238312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0799ccd-4fb3-496a-a641-802bd3a0c133 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ee0bb518b41478ab6403f510bfebe, user_id=d0d4f1a32f46423aa1e70a5d13c952c9, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:25.240065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0799ccd-4fb3-496a-a641-802bd3a0c133 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:25.331368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 138/264] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:58:24 2022] PUT /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/users/d0d4f1a32f46423aa1e70a5d13c952c9/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:25.393030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ac94-3e0b-44bf-a8c5-516991389f6c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:25.441552 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bd177-2a66-4b8e-9a42-fdfa8a17ee58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:25.442587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bd177-2a66-4b8e-9a42-fdfa8a17ee58 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:25.443071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bd177-2a66-4b8e-9a42-fdfa8a17ee58 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:25.443536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bd177-2a66-4b8e-9a42-fdfa8a17ee58 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:25.444425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bd177-2a66-4b8e-9a42-fdfa8a17ee58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:25.444943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bd177-2a66-4b8e-9a42-fdfa8a17ee58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:25.446597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bd177-2a66-4b8e-9a42-fdfa8a17ee58 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:25.463287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 127/265] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:25.469576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0799ccd-4fb3-496a-a641-802bd3a0c133 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:25.658939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0799ccd-4fb3-496a-a641-802bd3a0c133 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:25.676842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:25.703238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b25c0-b54c-48e7-91a2-35cf7154fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:25.704437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b25c0-b54c-48e7-91a2-35cf7154fe7c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:25.705438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b25c0-b54c-48e7-91a2-35cf7154fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:25.705930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b25c0-b54c-48e7-91a2-35cf7154fe7c None admin] PATH_INFO: `/v3/users/845409167b5c4bb39ad95ad4156ae970` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:25.707449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b25c0-b54c-48e7-91a2-35cf7154fe7c None admin] RBAC: Authorizing `identity:get_user(user_id=845409167b5c4bb39ad95ad4156ae970)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:25.709190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b25c0-b54c-48e7-91a2-35cf7154fe7c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:25.711490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 139/266] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:25 2022] GET /identity/v3/users/845409167b5c4bb39ad95ad4156ae970 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:25.719211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bd177-2a66-4b8e-9a42-fdfa8a17ee58 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:25.730777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40767f4-87e3-4255-a4f4-137d7ede5dee None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:25.731349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40767f4-87e3-4255-a4f4-137d7ede5dee None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:25.731852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40767f4-87e3-4255-a4f4-137d7ede5dee None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:25.733465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 140/267] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:25.743298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd9d6f-8205-491f-9023-0279038eb240 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:25.743701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd9d6f-8205-491f-9023-0279038eb240 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:25.744033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd9d6f-8205-491f-9023-0279038eb240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:25.777572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-55bd9d6f-8205-491f-9023-0279038eb240 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:25.778806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-55bd9d6f-8205-491f-9023-0279038eb240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:25.803506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:25.892371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bd177-2a66-4b8e-9a42-fdfa8a17ee58 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:25.944575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 141/268] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:25.985110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a37f3a-5a24-4a6e-bba1-cea399b382fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:25.986889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a37f3a-5a24-4a6e-bba1-cea399b382fe None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:25.987371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a37f3a-5a24-4a6e-bba1-cea399b382fe None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:25.987884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a37f3a-5a24-4a6e-bba1-cea399b382fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.127425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a37f3a-5a24-4a6e-bba1-cea399b382fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:26.129053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a37f3a-5a24-4a6e-bba1-cea399b382fe None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:26.189869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c11628-7e41-4d4e-bbf2-f5e6aeae4314 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:26.190353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c11628-7e41-4d4e-bbf2-f5e6aeae4314 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:26.190823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c11628-7e41-4d4e-bbf2-f5e6aeae4314 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.192313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 142/269] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:58:26.194899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:26.207330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8f5b-15a4-42f8-b56a-ca688704dcc7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:26.208035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8f5b-15a4-42f8-b56a-ca688704dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:26.208608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8f5b-15a4-42f8-b56a-ca688704dcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.244325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-39aa8f5b-15a4-42f8-b56a-ca688704dcc7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:26.245919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-39aa8f5b-15a4-42f8-b56a-ca688704dcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:26.274615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 128/270] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:26.283283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a37f3a-5a24-4a6e-bba1-cea399b382fe None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:26.362527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 143/271] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:26.363412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8f5b-15a4-42f8-b56a-ca688704dcc7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:26.434342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:26.440400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a37f3a-5a24-4a6e-bba1-cea399b382fe None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:26.483401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6bbb6-aecd-4a99-9e3d-4f6d99fa394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:26.484534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6bbb6-aecd-4a99-9e3d-4f6d99fa394a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:26.485008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6bbb6-aecd-4a99-9e3d-4f6d99fa394a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:26.485474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6bbb6-aecd-4a99-9e3d-4f6d99fa394a None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.487603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6bbb6-aecd-4a99-9e3d-4f6d99fa394a None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:26.489504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6bbb6-aecd-4a99-9e3d-4f6d99fa394a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:26.491568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 129/272] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:26 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:26.494094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c981a-8b7e-4b9d-947f-f5ed160ac3a0 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:26.494619 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c981a-8b7e-4b9d-947f-f5ed160ac3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:26.495129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c981a-8b7e-4b9d-947f-f5ed160ac3a0 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.496978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 130/273] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:26.502862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c981a-8b7e-4b9d-947f-f5ed160ac3a0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:26.517621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8f5b-15a4-42f8-b56a-ca688704dcc7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:26.530199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:26.558115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e67b8-62ef-4456-a90f-4c47dbe461a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:26.559728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e67b8-62ef-4456-a90f-4c47dbe461a6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:26.559728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e67b8-62ef-4456-a90f-4c47dbe461a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:26.559728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e67b8-62ef-4456-a90f-4c47dbe461a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.572854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e67b8-62ef-4456-a90f-4c47dbe461a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a12e67b8-62ef-4456-a90f-4c47dbe461a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:26.580897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:26.582254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:26.583289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:26.584555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 144/274] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:26.586007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8078e4-28e6-4724-a37e-9ccb8d072366 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:26.586392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8078e4-28e6-4724-a37e-9ccb8d072366 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:26.586765 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8078e4-28e6-4724-a37e-9ccb8d072366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.612187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-db8078e4-28e6-4724-a37e-9ccb8d072366 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:26.613661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-db8078e4-28e6-4724-a37e-9ccb8d072366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:26.658439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c981a-8b7e-4b9d-947f-f5ed160ac3a0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:26.703203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 145/275] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:26.703203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8078e4-28e6-4724-a37e-9ccb8d072366 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:26.707676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902d172-8781-43e3-a0b4-2155d4b33166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:26.708659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902d172-8781-43e3-a0b4-2155d4b33166 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:26.709153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902d172-8781-43e3-a0b4-2155d4b33166 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:26.709624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902d172-8781-43e3-a0b4-2155d4b33166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.710566 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902d172-8781-43e3-a0b4-2155d4b33166 None admin] RBAC: Adding query filter params (role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe, user.id=845409167b5c4bb39ad95ad4156ae970) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:26.711265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902d172-8781-43e3-a0b4-2155d4b33166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:26.713624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902d172-8781-43e3-a0b4-2155d4b33166 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:26.722330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 131/276] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:26 2022] GET /identity/v3/role_assignments?user.id=845409167b5c4bb39ad95ad4156ae970&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:26.734353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:26.741190 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902d172-8781-43e3-a0b4-2155d4b33166 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:26.829148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8078e4-28e6-4724-a37e-9ccb8d072366 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:26.839987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:26.859253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902d172-8781-43e3-a0b4-2155d4b33166 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:26.884571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295a677-d2b6-489d-bbcb-5101cdc3fe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:26.885247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295a677-d2b6-489d-bbcb-5101cdc3fe0d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:26.885527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295a677-d2b6-489d-bbcb-5101cdc3fe0d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:26.885877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295a677-d2b6-489d-bbcb-5101cdc3fe0d None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.886583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295a677-d2b6-489d-bbcb-5101cdc3fe0d None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:26.886889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295a677-d2b6-489d-bbcb-5101cdc3fe0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:26.888549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295a677-d2b6-489d-bbcb-5101cdc3fe0d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:26.899263 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 146/277] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:26.901278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9767b6-3664-4d36-99eb-914f1eaedd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:26.901934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9767b6-3664-4d36-99eb-914f1eaedd57 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:26.902331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9767b6-3664-4d36-99eb-914f1eaedd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:26.902694 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9767b6-3664-4d36-99eb-914f1eaedd57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:26.904022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9767b6-3664-4d36-99eb-914f1eaedd57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:26.905524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9767b6-3664-4d36-99eb-914f1eaedd57 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:26.907467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 132/278] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:26.912332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295a677-d2b6-489d-bbcb-5101cdc3fe0d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:26.913825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9767b6-3664-4d36-99eb-914f1eaedd57 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:27.083606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:27.093489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9767b6-3664-4d36-99eb-914f1eaedd57 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:27.098271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295a677-d2b6-489d-bbcb-5101cdc3fe0d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:27.139933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0c2e-03ee-47d4-9b19-3ba6787305e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:27.140727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0c2e-03ee-47d4-9b19-3ba6787305e3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:27.141083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0c2e-03ee-47d4-9b19-3ba6787305e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:27.141362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0c2e-03ee-47d4-9b19-3ba6787305e3 None admin] PATH_INFO: `/v3/users/e0f06db5e81f45e281bc1b3aee299145` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:27.144038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65173a6-7588-4d0f-8d64-67d49c515d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:27.144654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65173a6-7588-4d0f-8d64-67d49c515d73 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:27.144933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65173a6-7588-4d0f-8d64-67d49c515d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:27.145199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65173a6-7588-4d0f-8d64-67d49c515d73 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:27.146549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65173a6-7588-4d0f-8d64-67d49c515d73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:27.148086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65173a6-7588-4d0f-8d64-67d49c515d73 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:27.159714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0c2e-03ee-47d4-9b19-3ba6787305e3 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f06db5e81f45e281bc1b3aee299145)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:27.161436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0c2e-03ee-47d4-9b19-3ba6787305e3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:27.167903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 147/279] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:26 2022] GET /identity/v3/users/e0f06db5e81f45e281bc1b3aee299145 => generated 293 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:27.168809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0c2e-03ee-47d4-9b19-3ba6787305e3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:27.289311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0c2e-03ee-47d4-9b19-3ba6787305e3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:27.307785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 133/280] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:58:26 2022] POST /identity/v3/users => generated 293 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:27.307785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65173a6-7588-4d0f-8d64-67d49c515d73 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:27.320825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:27.345493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de2f5b-0208-48fd-a7a6-a743139dfbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:27.346956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de2f5b-0208-48fd-a7a6-a743139dfbfb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:27.347433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de2f5b-0208-48fd-a7a6-a743139dfbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:27.347885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de2f5b-0208-48fd-a7a6-a743139dfbfb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:27.366892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de2f5b-0208-48fd-a7a6-a743139dfbfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f7de2f5b-0208-48fd-a7a6-a743139dfbfb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:27.376311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:27.377486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:27.378464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 148/281] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:27.384394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de2f5b-0208-48fd-a7a6-a743139dfbfb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:27.401914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:27.468167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65173a6-7588-4d0f-8d64-67d49c515d73 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:27.527042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caccfd-f32d-4b3f-8800-796c9b550934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:27.528351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caccfd-f32d-4b3f-8800-796c9b550934 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:27.529463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caccfd-f32d-4b3f-8800-796c9b550934 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:27.530160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caccfd-f32d-4b3f-8800-796c9b550934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:27.531575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caccfd-f32d-4b3f-8800-796c9b550934 None admin] RBAC: Adding query filter params (role.id=eae8aac7335344e48b3a6e3b9ffcba0a, user.id=e0f06db5e81f45e281bc1b3aee299145, scope.system=all) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:27.532170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caccfd-f32d-4b3f-8800-796c9b550934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:27.536520 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caccfd-f32d-4b3f-8800-796c9b550934 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:27.548857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 134/282] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Aug 31 10:58:27 2022] GET /identity/v3/role_assignments?user.id=e0f06db5e81f45e281bc1b3aee299145&scope.system=all&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:27.551321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de2f5b-0208-48fd-a7a6-a743139dfbfb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:27.612885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2b08f-6e9f-4490-b09a-59d15fc0f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:27.613560 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2b08f-6e9f-4490-b09a-59d15fc0f67b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:27.613889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2b08f-6e9f-4490-b09a-59d15fc0f67b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:27.614171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2b08f-6e9f-4490-b09a-59d15fc0f67b None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:27.616495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2b08f-6e9f-4490-b09a-59d15fc0f67b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:27.616495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2b08f-6e9f-4490-b09a-59d15fc0f67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:27.619174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2b08f-6e9f-4490-b09a-59d15fc0f67b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:27.631348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 149/283] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:27.636788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caccfd-f32d-4b3f-8800-796c9b550934 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:27.745130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:27.781101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caccfd-f32d-4b3f-8800-796c9b550934 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:27.820066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3877f-81c5-4e5c-ac09-22d5edeea69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:27.820762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3877f-81c5-4e5c-ac09-22d5edeea69a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:27.821045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3877f-81c5-4e5c-ac09-22d5edeea69a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:27.821317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3877f-81c5-4e5c-ac09-22d5edeea69a None admin] PATH_INFO: `/v3/users/ec1ffbf9b1324bec962cad1e21e2960c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:27.822573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3877f-81c5-4e5c-ac09-22d5edeea69a None admin] RBAC: Authorizing `identity:get_user(user_id=ec1ffbf9b1324bec962cad1e21e2960c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:27.824272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3877f-81c5-4e5c-ac09-22d5edeea69a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:27.826427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 135/284] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:27 2022] GET /identity/v3/users/ec1ffbf9b1324bec962cad1e21e2960c => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:27.833261 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2b08f-6e9f-4490-b09a-59d15fc0f67b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:27.944135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:27.983850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2b08f-6e9f-4490-b09a-59d15fc0f67b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:28.035088 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9727b9-66da-49a3-a33e-cb44779eccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:28.036240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9727b9-66da-49a3-a33e-cb44779eccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:28.036724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9727b9-66da-49a3-a33e-cb44779eccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:28.037195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9727b9-66da-49a3-a33e-cb44779eccf3 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:28.038624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9727b9-66da-49a3-a33e-cb44779eccf3 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:28.040360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9727b9-66da-49a3-a33e-cb44779eccf3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:28.042290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 150/285] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:27 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:28.053657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3877f-81c5-4e5c-ac09-22d5edeea69a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:28.157157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac53da-1c8c-4cbe-a5df-eb413ea41452 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:28.158688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac53da-1c8c-4cbe-a5df-eb413ea41452 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:28.159161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac53da-1c8c-4cbe-a5df-eb413ea41452 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:28.161026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 151/286] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:28.166469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304aefd-995f-4e8e-825b-8cc10bcf69c6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:28.167002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304aefd-995f-4e8e-825b-8cc10bcf69c6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:28.167490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304aefd-995f-4e8e-825b-8cc10bcf69c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:28.197687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4304aefd-995f-4e8e-825b-8cc10bcf69c6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:28.197687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4304aefd-995f-4e8e-825b-8cc10bcf69c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:28.242294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3877f-81c5-4e5c-ac09-22d5edeea69a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:28.291774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51faa1-b93f-4164-9787-055ffa874572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:28.293064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51faa1-b93f-4164-9787-055ffa874572 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:28.293353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51faa1-b93f-4164-9787-055ffa874572 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:28.293632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51faa1-b93f-4164-9787-055ffa874572 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/users/ec1ffbf9b1324bec962cad1e21e2960c/roles/59ee78b0895446c0b5244158b1252b64` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:28.295631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51faa1-b93f-4164-9787-055ffa874572 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ee0bb518b41478ab6403f510bfebe, user_id=ec1ffbf9b1324bec962cad1e21e2960c, role_id=59ee78b0895446c0b5244158b1252b64)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:28.297692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51faa1-b93f-4164-9787-055ffa874572 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:28.338224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 152/287] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:28.376342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:28.382085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 136/288] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:58:28 2022] PUT /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/users/ec1ffbf9b1324bec962cad1e21e2960c/roles/59ee78b0895446c0b5244158b1252b64 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:28.623056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304aefd-995f-4e8e-825b-8cc10bcf69c6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:28.708846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:28.777589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304aefd-995f-4e8e-825b-8cc10bcf69c6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:28.821179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee9b9e-cfa4-4b3f-87aa-0283d65066f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:28.821844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee9b9e-cfa4-4b3f-87aa-0283d65066f1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:28.822120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee9b9e-cfa4-4b3f-87aa-0283d65066f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:28.822389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee9b9e-cfa4-4b3f-87aa-0283d65066f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:28.835044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee9b9e-cfa4-4b3f-87aa-0283d65066f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e8ee9b9e-cfa4-4b3f-87aa-0283d65066f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:28.840464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:28.841369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:28.842147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 153/289] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:28.848606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51faa1-b93f-4164-9787-055ffa874572 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:28.979850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51faa1-b93f-4164-9787-055ffa874572 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:29.026304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf66b2-5284-417f-bd61-06b04e3f8d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:29.027005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf66b2-5284-417f-bd61-06b04e3f8d18 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:29.027316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf66b2-5284-417f-bd61-06b04e3f8d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:29.027591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf66b2-5284-417f-bd61-06b04e3f8d18 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:29.028316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf66b2-5284-417f-bd61-06b04e3f8d18 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:29.028627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf66b2-5284-417f-bd61-06b04e3f8d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:29.030046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf66b2-5284-417f-bd61-06b04e3f8d18 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:29.040707 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 137/290] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:29.049307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee9b9e-cfa4-4b3f-87aa-0283d65066f1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:29.221185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee9b9e-cfa4-4b3f-87aa-0283d65066f1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:29.272459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:29.291515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf52c6-8b69-418c-8812-c63d256d2bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:29.292198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf52c6-8b69-418c-8812-c63d256d2bcf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:29.292477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf52c6-8b69-418c-8812-c63d256d2bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:29.292754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf52c6-8b69-418c-8812-c63d256d2bcf None admin] PATH_INFO: `/v3/users/d0d4f1a32f46423aa1e70a5d13c952c9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:29.293968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf52c6-8b69-418c-8812-c63d256d2bcf None admin] RBAC: Authorizing `identity:get_user(user_id=d0d4f1a32f46423aa1e70a5d13c952c9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:29.295444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf52c6-8b69-418c-8812-c63d256d2bcf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:29.297441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 154/291] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:29 2022] GET /identity/v3/users/d0d4f1a32f46423aa1e70a5d13c952c9 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:29.304942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf66b2-5284-417f-bd61-06b04e3f8d18 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:29.443679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:29.498330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf66b2-5284-417f-bd61-06b04e3f8d18 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:29.556840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd18af1-6011-4d91-b472-51b8f6cef8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:29.557526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd18af1-6011-4d91-b472-51b8f6cef8bf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:29.557814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd18af1-6011-4d91-b472-51b8f6cef8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:29.558091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd18af1-6011-4d91-b472-51b8f6cef8bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:29.662184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd18af1-6011-4d91-b472-51b8f6cef8bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:29.663813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd18af1-6011-4d91-b472-51b8f6cef8bf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:29.743306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:29.795705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 138/292] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:29.802009 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf52c6-8b69-418c-8812-c63d256d2bcf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:29.943938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf52c6-8b69-418c-8812-c63d256d2bcf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:29.987719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41830951-d51a-4348-bcb7-17def9440b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:29.988398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830951-d51a-4348-bcb7-17def9440b2b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:29.988678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830951-d51a-4348-bcb7-17def9440b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:29.988952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830951-d51a-4348-bcb7-17def9440b2b None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:29.990137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41830951-d51a-4348-bcb7-17def9440b2b None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:29.991588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41830951-d51a-4348-bcb7-17def9440b2b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:29.993271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 155/293] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:29 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:30.000903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd18af1-6011-4d91-b472-51b8f6cef8bf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:30.150039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd18af1-6011-4d91-b472-51b8f6cef8bf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:30.195545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09438bd4-6e80-4ce2-b7ce-9a7449c87c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:30.196111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09438bd4-6e80-4ce2-b7ce-9a7449c87c90 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.196391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09438bd4-6e80-4ce2-b7ce-9a7449c87c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.196670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09438bd4-6e80-4ce2-b7ce-9a7449c87c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.197412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09438bd4-6e80-4ce2-b7ce-9a7449c87c90 None admin] RBAC: Adding query filter params (role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe, user.id=d0d4f1a32f46423aa1e70a5d13c952c9) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:30.197808 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09438bd4-6e80-4ce2-b7ce-9a7449c87c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:30.199324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09438bd4-6e80-4ce2-b7ce-9a7449c87c90 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:30.205943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246566aa-b3e1-442b-98fa-78e55da61064 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.206281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246566aa-b3e1-442b-98fa-78e55da61064 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.206496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246566aa-b3e1-442b-98fa-78e55da61064 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.206830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 139/294] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:29 2022] GET /identity/v3/role_assignments?user.id=d0d4f1a32f46423aa1e70a5d13c952c9&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:30.207930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 156/295] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:30.213872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9c82d-60a0-4193-94a9-6552de2ad542 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.214165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9c82d-60a0-4193-94a9-6552de2ad542 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.214426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9c82d-60a0-4193-94a9-6552de2ad542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.245089 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e3b9c82d-60a0-4193-94a9-6552de2ad542 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:30.246370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e3b9c82d-60a0-4193-94a9-6552de2ad542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:30.273322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc721bb-2ba1-4a83-8dc7-d3d1ab4b8cde None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.273872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc721bb-2ba1-4a83-8dc7-d3d1ab4b8cde None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.273872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc721bb-2ba1-4a83-8dc7-d3d1ab4b8cde None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.275244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 157/296] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:30.277812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:30.293302 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2919f-e733-4edf-9d72-da1e5c8cda4d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.299147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2919f-e733-4edf-9d72-da1e5c8cda4d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.299147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2919f-e733-4edf-9d72-da1e5c8cda4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.337627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0ca2919f-e733-4edf-9d72-da1e5c8cda4d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:30.338935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0ca2919f-e733-4edf-9d72-da1e5c8cda4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:30.350489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 140/297] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:30.445083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:30.459508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 158/298] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:30.569590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579891-38ea-4310-8734-e2e161c17339 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.570102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579891-38ea-4310-8734-e2e161c17339 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.570600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579891-38ea-4310-8734-e2e161c17339 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.572349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 141/299] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:30.578204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c5f9d-8712-4fcf-b3b7-20b9860f7e7c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.578678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c5f9d-8712-4fcf-b3b7-20b9860f7e7c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.579089 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c5f9d-8712-4fcf-b3b7-20b9860f7e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.603224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b12c5f9d-8712-4fcf-b3b7-20b9860f7e7c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:30.604743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b12c5f9d-8712-4fcf-b3b7-20b9860f7e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:30.635727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579891-38ea-4310-8734-e2e161c17339 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:30.706241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 159/300] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:30.766706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c5f9d-8712-4fcf-b3b7-20b9860f7e7c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:30.818631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579891-38ea-4310-8734-e2e161c17339 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:30.875488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef10ec-2116-4076-bf58-a51ca7b835bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:30.876904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef10ec-2116-4076-bf58-a51ca7b835bc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.877336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef10ec-2116-4076-bf58-a51ca7b835bc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.877747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef10ec-2116-4076-bf58-a51ca7b835bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.889821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef10ec-2116-4076-bf58-a51ca7b835bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-04ef10ec-2116-4076-bf58-a51ca7b835bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:30.895601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:30.897021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:30.898092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:30.900556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 142/301] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:30.912623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c5f9d-8712-4fcf-b3b7-20b9860f7e7c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:30.914678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef10ec-2116-4076-bf58-a51ca7b835bc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:30.940226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:30.961756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:30.972924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ed5a7-4dba-4a90-8847-3f8e42371b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:30.974002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ed5a7-4dba-4a90-8847-3f8e42371b75 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.974537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ed5a7-4dba-4a90-8847-3f8e42371b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.974966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ed5a7-4dba-4a90-8847-3f8e42371b75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.987812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ed5a7-4dba-4a90-8847-3f8e42371b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d85ed5a7-4dba-4a90-8847-3f8e42371b75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:30.993239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:30.994265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:30.995151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:31.002133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 160/302] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:31.003602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ed5a7-4dba-4a90-8847-3f8e42371b75 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:31.054057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef10ec-2116-4076-bf58-a51ca7b835bc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:31.090982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f65494-4489-44c9-815e-41fba12a7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:31.091599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65494-4489-44c9-815e-41fba12a7b02 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.091891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65494-4489-44c9-815e-41fba12a7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.092162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65494-4489-44c9-815e-41fba12a7b02 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.092826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f65494-4489-44c9-815e-41fba12a7b02 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:31.093122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f65494-4489-44c9-815e-41fba12a7b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:31.094497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f65494-4489-44c9-815e-41fba12a7b02 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:31.104512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 143/303] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:31.105990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da788f0-23de-4ce9-82d3-a3f1547289ea None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.106274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da788f0-23de-4ce9-82d3-a3f1547289ea None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.106545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da788f0-23de-4ce9-82d3-a3f1547289ea None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.112021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 144/304] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:31.112779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da788f0-23de-4ce9-82d3-a3f1547289ea None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:31.124404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ed5a7-4dba-4a90-8847-3f8e42371b75 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:31.161605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261611a4-678d-4e69-ba7b-6b31be527735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:31.162206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261611a4-678d-4e69-ba7b-6b31be527735 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.162476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261611a4-678d-4e69-ba7b-6b31be527735 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.162744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261611a4-678d-4e69-ba7b-6b31be527735 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.163404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261611a4-678d-4e69-ba7b-6b31be527735 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:31.163696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261611a4-678d-4e69-ba7b-6b31be527735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:31.165104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261611a4-678d-4e69-ba7b-6b31be527735 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:31.174432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 161/305] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:31.182826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261611a4-678d-4e69-ba7b-6b31be527735 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:31.207247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:31.225709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:31.232506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da788f0-23de-4ce9-82d3-a3f1547289ea None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:31.272582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b5530-09e3-45ac-8cbf-169e7f479128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:31.273218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b5530-09e3-45ac-8cbf-169e7f479128 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.273497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b5530-09e3-45ac-8cbf-169e7f479128 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.273772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b5530-09e3-45ac-8cbf-169e7f479128 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.274959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b5530-09e3-45ac-8cbf-169e7f479128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:31.276519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b5530-09e3-45ac-8cbf-169e7f479128 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:31.278184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 145/306] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:31.279379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff51dfc-214f-440b-8165-68e73de70f50 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.279687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff51dfc-214f-440b-8165-68e73de70f50 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.279951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff51dfc-214f-440b-8165-68e73de70f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.297076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261611a4-678d-4e69-ba7b-6b31be527735 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:31.318726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7ff51dfc-214f-440b-8165-68e73de70f50 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:31.319871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7ff51dfc-214f-440b-8165-68e73de70f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:31.336939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f3b19-0616-4d27-9b71-11de59489de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:31.337847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3b19-0616-4d27-9b71-11de59489de9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.338262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3b19-0616-4d27-9b71-11de59489de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.338528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3b19-0616-4d27-9b71-11de59489de9 None admin] PATH_INFO: `/v3/users/e0f06db5e81f45e281bc1b3aee299145` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.339779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f3b19-0616-4d27-9b71-11de59489de9 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f06db5e81f45e281bc1b3aee299145)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:31.341249 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f3b19-0616-4d27-9b71-11de59489de9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:31.343443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 162/307] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:31 2022] GET /identity/v3/users/e0f06db5e81f45e281bc1b3aee299145 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:31.344233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f3b19-0616-4d27-9b71-11de59489de9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:31.396753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 146/308] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:31.397598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff51dfc-214f-440b-8165-68e73de70f50 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:31.462915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f3b19-0616-4d27-9b71-11de59489de9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:31.482409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:31.492870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:31.505132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ccf6-3e6b-4132-9ef3-c7e19f5c7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:31.505762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ccf6-3e6b-4132-9ef3-c7e19f5c7648 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.506709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ccf6-3e6b-4132-9ef3-c7e19f5c7648 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.507250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ccf6-3e6b-4132-9ef3-c7e19f5c7648 None admin] PATH_INFO: `/v3/users/fe43e3095f7b4e9c8726db925948a3b9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.524072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff51dfc-214f-440b-8165-68e73de70f50 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:31.524269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ccf6-3e6b-4132-9ef3-c7e19f5c7648 None admin] RBAC: Authorizing `identity:get_user(user_id=fe43e3095f7b4e9c8726db925948a3b9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:31.526187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ccf6-3e6b-4132-9ef3-c7e19f5c7648 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:31.528812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 163/309] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:31 2022] GET /identity/v3/users/fe43e3095f7b4e9c8726db925948a3b9 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:31.529592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ccf6-3e6b-4132-9ef3-c7e19f5c7648 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:31.568355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6204c7-6620-4b39-96cb-7a84d2dbd155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:31.569025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6204c7-6620-4b39-96cb-7a84d2dbd155 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.569245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6204c7-6620-4b39-96cb-7a84d2dbd155 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.569508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6204c7-6620-4b39-96cb-7a84d2dbd155 None admin] PATH_INFO: `/v3/groups` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.570138 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6204c7-6620-4b39-96cb-7a84d2dbd155 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:31.571569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6204c7-6620-4b39-96cb-7a84d2dbd155 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:31.650029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ccf6-3e6b-4132-9ef3-c7e19f5c7648 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:31.685661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 147/310] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Aug 31 10:58:31 2022] POST /identity/v3/groups => generated 229 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:31.687146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6204c7-6620-4b39-96cb-7a84d2dbd155 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:31.687987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211dd16-9365-4ad8-bdd2-5d018c590c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:31.688658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dd16-9365-4ad8-bdd2-5d018c590c8a None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.689023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dd16-9365-4ad8-bdd2-5d018c590c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.689299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dd16-9365-4ad8-bdd2-5d018c590c8a None admin] PATH_INFO: `/v3/system/users/e0f06db5e81f45e281bc1b3aee299145/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.690806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211dd16-9365-4ad8-bdd2-5d018c590c8a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e0f06db5e81f45e281bc1b3aee299145, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:31.695532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211dd16-9365-4ad8-bdd2-5d018c590c8a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:31.808520 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 164/311] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Aug 31 10:58:31 2022] PUT /identity/v3/system/users/e0f06db5e81f45e281bc1b3aee299145/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:31.810081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211dd16-9365-4ad8-bdd2-5d018c590c8a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:31.814165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6204c7-6620-4b39-96cb-7a84d2dbd155 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:31.875608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2829bd-f8a4-4532-8da0-cad3909cedf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:31.877269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2829bd-f8a4-4532-8da0-cad3909cedf9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:31.877552 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2829bd-f8a4-4532-8da0-cad3909cedf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:31.877812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2829bd-f8a4-4532-8da0-cad3909cedf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:31.878581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2829bd-f8a4-4532-8da0-cad3909cedf9 None admin] RBAC: Adding query filter params (role.id=59ee78b0895446c0b5244158b1252b64, user.id=fe43e3095f7b4e9c8726db925948a3b9, scope.system=all) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:31.878887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2829bd-f8a4-4532-8da0-cad3909cedf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:31.880492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2829bd-f8a4-4532-8da0-cad3909cedf9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:31.881742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:31.889768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:31.890060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 148/312] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Aug 31 10:58:31 2022] GET /identity/v3/role_assignments?user.id=fe43e3095f7b4e9c8726db925948a3b9&scope.system=all&role.id=59ee78b0895446c0b5244158b1252b64 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:31.971208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211dd16-9365-4ad8-bdd2-5d018c590c8a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:32.026427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84906-ced9-4b68-96a2-f61e2d9dde73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:32.028087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84906-ced9-4b68-96a2-f61e2d9dde73 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:32.028644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84906-ced9-4b68-96a2-f61e2d9dde73 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:32.029143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84906-ced9-4b68-96a2-f61e2d9dde73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:32.043510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84906-ced9-4b68-96a2-f61e2d9dde73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8db84906-ced9-4b68-96a2-f61e2d9dde73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:32.049891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:32.050907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:32.051708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:32.054794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 165/313] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:32.060498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2829bd-f8a4-4532-8da0-cad3909cedf9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:32.180085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2829bd-f8a4-4532-8da0-cad3909cedf9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:32.220621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85c8eb-1d92-4149-8951-763c2cd6f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:32.221987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c8eb-1d92-4149-8951-763c2cd6f357 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:32.222424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c8eb-1d92-4149-8951-763c2cd6f357 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:32.222848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c8eb-1d92-4149-8951-763c2cd6f357 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:32.223855 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85c8eb-1d92-4149-8951-763c2cd6f357 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:32.224309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85c8eb-1d92-4149-8951-763c2cd6f357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:32.225886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85c8eb-1d92-4149-8951-763c2cd6f357 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:32.237147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 149/314] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:32.243772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84906-ced9-4b68-96a2-f61e2d9dde73 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:32.361643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:32.368821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84906-ced9-4b68-96a2-f61e2d9dde73 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:32.408732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaff765-3413-4348-87e5-e1395a9460f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:32.409664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaff765-3413-4348-87e5-e1395a9460f4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:32.409947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaff765-3413-4348-87e5-e1395a9460f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:32.410220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaff765-3413-4348-87e5-e1395a9460f4 None admin] PATH_INFO: `/v3/users/ec1ffbf9b1324bec962cad1e21e2960c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:32.411466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaff765-3413-4348-87e5-e1395a9460f4 None admin] RBAC: Authorizing `identity:get_user(user_id=ec1ffbf9b1324bec962cad1e21e2960c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:32.413254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaff765-3413-4348-87e5-e1395a9460f4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:32.415334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 166/315] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:32 2022] GET /identity/v3/users/ec1ffbf9b1324bec962cad1e21e2960c => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:32.421098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85c8eb-1d92-4149-8951-763c2cd6f357 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:32.522369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:32.569575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85c8eb-1d92-4149-8951-763c2cd6f357 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:32.606319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495b62b-f8f6-4c2c-bd90-37d10ad01c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:32.606939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495b62b-f8f6-4c2c-bd90-37d10ad01c9c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:32.607220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495b62b-f8f6-4c2c-bd90-37d10ad01c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:32.607557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495b62b-f8f6-4c2c-bd90-37d10ad01c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:32.686041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495b62b-f8f6-4c2c-bd90-37d10ad01c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:32.687623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495b62b-f8f6-4c2c-bd90-37d10ad01c9c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:32.766240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:32.811735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 150/316] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:32.818175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaff765-3413-4348-87e5-e1395a9460f4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:32.947068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaff765-3413-4348-87e5-e1395a9460f4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:32.982467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf688-b723-4c09-a2f3-439bc12f33c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:32.983108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf688-b723-4c09-a2f3-439bc12f33c8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:32.983386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf688-b723-4c09-a2f3-439bc12f33c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:32.983655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf688-b723-4c09-a2f3-439bc12f33c8 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:32.984831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaf688-b723-4c09-a2f3-439bc12f33c8 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:32.986589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaf688-b723-4c09-a2f3-439bc12f33c8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:32.988955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 167/317] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:32 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:32.997885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495b62b-f8f6-4c2c-bd90-37d10ad01c9c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:33.144378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495b62b-f8f6-4c2c-bd90-37d10ad01c9c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:33.181406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3a426-7d5d-4d1a-ac24-db90cfbd44eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:33.182078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a426-7d5d-4d1a-ac24-db90cfbd44eb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:33.182394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a426-7d5d-4d1a-ac24-db90cfbd44eb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:33.182660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a426-7d5d-4d1a-ac24-db90cfbd44eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:33.183385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a426-7d5d-4d1a-ac24-db90cfbd44eb None admin] RBAC: Adding query filter params (role.id=59ee78b0895446c0b5244158b1252b64, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe, user.id=ec1ffbf9b1324bec962cad1e21e2960c) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:33.183686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a426-7d5d-4d1a-ac24-db90cfbd44eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:33.185134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a426-7d5d-4d1a-ac24-db90cfbd44eb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:33.195771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 151/318] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:58:32 2022] GET /identity/v3/role_assignments?user.id=ec1ffbf9b1324bec962cad1e21e2960c&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=59ee78b0895446c0b5244158b1252b64 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:33.947297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8dfe-c4eb-4278-a3ed-5d7ff7d7be6a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:33.948033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8dfe-c4eb-4278-a3ed-5d7ff7d7be6a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:33.948033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8dfe-c4eb-4278-a3ed-5d7ff7d7be6a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:33.949243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 168/319] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:33.955332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dc26a-9ac5-443f-be8e-cb885517c93b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:33.955708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dc26a-9ac5-443f-be8e-cb885517c93b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:33.956016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dc26a-9ac5-443f-be8e-cb885517c93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:33.976797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a91dc26a-9ac5-443f-be8e-cb885517c93b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:33.978000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a91dc26a-9ac5-443f-be8e-cb885517c93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:33.993374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49964-5b72-4618-a8b0-bf9c867d639c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:33.993676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49964-5b72-4618-a8b0-bf9c867d639c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:33.993921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49964-5b72-4618-a8b0-bf9c867d639c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:33.995277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 169/320] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:58:34.000477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1e4ee-ab92-44bf-8e27-ffeaad848f59 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:34.000759 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1e4ee-ab92-44bf-8e27-ffeaad848f59 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:34.001033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1e4ee-ab92-44bf-8e27-ffeaad848f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:34.007652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:34.026003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bee1e4ee-ab92-44bf-8e27-ffeaad848f59 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:34.027501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bee1e4ee-ab92-44bf-8e27-ffeaad848f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:34.057563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:34.065935 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 152/321] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:34.067737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce52fd6-05a5-4188-b757-562934c2e00e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:34.068211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce52fd6-05a5-4188-b757-562934c2e00e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:34.068665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce52fd6-05a5-4188-b757-562934c2e00e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:34.071814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 153/322] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:34.076597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4a20b-1313-4ed3-8f74-eafede40b079 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:34.076884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4a20b-1313-4ed3-8f74-eafede40b079 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:34.077158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4a20b-1313-4ed3-8f74-eafede40b079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:34.108282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-03d4a20b-1313-4ed3-8f74-eafede40b079 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:34.110205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-03d4a20b-1313-4ed3-8f74-eafede40b079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:34.115216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 170/323] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:34.191941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 154/324] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:34.351887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1e4ee-ab92-44bf-8e27-ffeaad848f59 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:34.388889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4a20b-1313-4ed3-8f74-eafede40b079 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:34.464615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1e4ee-ab92-44bf-8e27-ffeaad848f59 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:34.490136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:34.499673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e5bb-7f10-4fb0-8927-cd6b4a008cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:34.500286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e5bb-7f10-4fb0-8927-cd6b4a008cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:34.500594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e5bb-7f10-4fb0-8927-cd6b4a008cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:34.511198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e5bb-7f10-4fb0-8927-cd6b4a008cb9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:34.511330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4a20b-1313-4ed3-8f74-eafede40b079 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:34.522393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4e5bb-7f10-4fb0-8927-cd6b4a008cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5de4e5bb-7f10-4fb0-8927-cd6b4a008cb9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:34.527391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:34.528508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:34.532799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 171/325] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:34.535240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e5bb-7f10-4fb0-8927-cd6b4a008cb9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:34.564701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1a8da-d9a2-40f5-b03f-8f8c7511d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:34.565677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1a8da-d9a2-40f5-b03f-8f8c7511d946 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:34.565962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1a8da-d9a2-40f5-b03f-8f8c7511d946 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:34.566240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1a8da-d9a2-40f5-b03f-8f8c7511d946 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:34.568006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:34.577750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1a8da-d9a2-40f5-b03f-8f8c7511d946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f5c1a8da-d9a2-40f5-b03f-8f8c7511d946 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:34.583577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:34.584894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:34.585672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 155/326] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:34.587345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1a8da-d9a2-40f5-b03f-8f8c7511d946 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:34.652608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e5bb-7f10-4fb0-8927-cd6b4a008cb9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:34.691491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc80f8a-741a-4102-ae17-b13bf3f15454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:34.692129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc80f8a-741a-4102-ae17-b13bf3f15454 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:34.692410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc80f8a-741a-4102-ae17-b13bf3f15454 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:34.692674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc80f8a-741a-4102-ae17-b13bf3f15454 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:34.693334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc80f8a-741a-4102-ae17-b13bf3f15454 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:34.693662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc80f8a-741a-4102-ae17-b13bf3f15454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:34.694999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc80f8a-741a-4102-ae17-b13bf3f15454 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:34.700425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1a8da-d9a2-40f5-b03f-8f8c7511d946 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:34.703966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 172/327] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:34.705416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc80f8a-741a-4102-ae17-b13bf3f15454 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:34.748008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd5dea-df0a-4b1f-be20-36ab07ae394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:34.748984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd5dea-df0a-4b1f-be20-36ab07ae394b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:34.749461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd5dea-df0a-4b1f-be20-36ab07ae394b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:34.749895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd5dea-df0a-4b1f-be20-36ab07ae394b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:34.751655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd5dea-df0a-4b1f-be20-36ab07ae394b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:34.754310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd5dea-df0a-4b1f-be20-36ab07ae394b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:34.757167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 156/328] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:34.758105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd5dea-df0a-4b1f-be20-36ab07ae394b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:34.777643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:34.806388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:34.821392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc80f8a-741a-4102-ae17-b13bf3f15454 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:34.858012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc64a8f-bae0-473e-83eb-da18b89d7696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:34.858630 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc64a8f-bae0-473e-83eb-da18b89d7696 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:34.858909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc64a8f-bae0-473e-83eb-da18b89d7696 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:34.859176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc64a8f-bae0-473e-83eb-da18b89d7696 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:34.859873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc64a8f-bae0-473e-83eb-da18b89d7696 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:34.860173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc64a8f-bae0-473e-83eb-da18b89d7696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:34.861627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc64a8f-bae0-473e-83eb-da18b89d7696 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:34.869175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd5dea-df0a-4b1f-be20-36ab07ae394b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:34.871395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 173/329] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:34.872211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc64a8f-bae0-473e-83eb-da18b89d7696 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:34.912106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55093e46-8d23-43f9-82e0-a6f6e644f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:34.912749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55093e46-8d23-43f9-82e0-a6f6e644f831 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:34.913027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55093e46-8d23-43f9-82e0-a6f6e644f831 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:34.913298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55093e46-8d23-43f9-82e0-a6f6e644f831 None admin] PATH_INFO: `/v3/users/fe43e3095f7b4e9c8726db925948a3b9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:34.914465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55093e46-8d23-43f9-82e0-a6f6e644f831 None admin] RBAC: Authorizing `identity:get_user(user_id=fe43e3095f7b4e9c8726db925948a3b9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:34.915962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55093e46-8d23-43f9-82e0-a6f6e644f831 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:34.917551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 157/330] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:34 2022] GET /identity/v3/users/fe43e3095f7b4e9c8726db925948a3b9 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:34.918317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55093e46-8d23-43f9-82e0-a6f6e644f831 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:34.978771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc64a8f-bae0-473e-83eb-da18b89d7696 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:35.014395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380e9e-433a-465d-94f4-5365e5ae9426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:35.015012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380e9e-433a-465d-94f4-5365e5ae9426 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:35.015289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380e9e-433a-465d-94f4-5365e5ae9426 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:35.015557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380e9e-433a-465d-94f4-5365e5ae9426 None admin] PATH_INFO: `/v3/groups` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:35.016222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f380e9e-433a-465d-94f4-5365e5ae9426 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:35.018356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:35.018496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f380e9e-433a-465d-94f4-5365e5ae9426 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:35.037679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55093e46-8d23-43f9-82e0-a6f6e644f831 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:35.076541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf585a4-2ebb-4ac2-a353-bcba5755dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:35.077099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf585a4-2ebb-4ac2-a353-bcba5755dc8d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:35.077379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf585a4-2ebb-4ac2-a353-bcba5755dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:35.077652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf585a4-2ebb-4ac2-a353-bcba5755dc8d None admin] PATH_INFO: `/v3/users/e0f06db5e81f45e281bc1b3aee299145` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:35.078964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf585a4-2ebb-4ac2-a353-bcba5755dc8d None admin] RBAC: Authorizing `identity:get_user(user_id=e0f06db5e81f45e281bc1b3aee299145)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:35.081398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf585a4-2ebb-4ac2-a353-bcba5755dc8d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:35.083022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 158/331] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:34 2022] GET /identity/v3/users/e0f06db5e81f45e281bc1b3aee299145 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:35.083943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf585a4-2ebb-4ac2-a353-bcba5755dc8d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:35.094237 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 174/332] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Aug 31 10:58:34 2022] POST /identity/v3/groups => generated 226 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:35.096706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380e9e-433a-465d-94f4-5365e5ae9426 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:35.117041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:35.228363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf585a4-2ebb-4ac2-a353-bcba5755dc8d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:35.254276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380e9e-433a-465d-94f4-5365e5ae9426 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:35.287108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8afae6-cda1-4745-9ecf-a9ac3a55d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:35.287804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8afae6-cda1-4745-9ecf-a9ac3a55d74e None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:35.291526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8afae6-cda1-4745-9ecf-a9ac3a55d74e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:35.291526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8afae6-cda1-4745-9ecf-a9ac3a55d74e None admin] PATH_INFO: `/v3/system/users/fe43e3095f7b4e9c8726db925948a3b9/roles/59ee78b0895446c0b5244158b1252b64` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:35.291526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8afae6-cda1-4745-9ecf-a9ac3a55d74e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fe43e3095f7b4e9c8726db925948a3b9, role_id=59ee78b0895446c0b5244158b1252b64)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:35.291526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8afae6-cda1-4745-9ecf-a9ac3a55d74e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:35.305849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0605cd3-bae5-481b-920c-876297fe024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:35.306466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0605cd3-bae5-481b-920c-876297fe024d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:35.306766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0605cd3-bae5-481b-920c-876297fe024d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:35.307038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0605cd3-bae5-481b-920c-876297fe024d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:35.307827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0605cd3-bae5-481b-920c-876297fe024d None admin] RBAC: Adding query filter params (role.id=eae8aac7335344e48b3a6e3b9ffcba0a, user.id=e0f06db5e81f45e281bc1b3aee299145, scope.system=all) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:35.308117 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0605cd3-bae5-481b-920c-876297fe024d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:35.309575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0605cd3-bae5-481b-920c-876297fe024d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:35.323124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 175/333] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Aug 31 10:58:35 2022] GET /identity/v3/role_assignments?user.id=e0f06db5e81f45e281bc1b3aee299145&scope.system=all&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 510 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:35.353117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 159/334] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Aug 31 10:58:35 2022] PUT /identity/v3/system/users/fe43e3095f7b4e9c8726db925948a3b9/roles/59ee78b0895446c0b5244158b1252b64 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:37.457143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b03cb-f18b-453a-803c-b510d93067ac None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:37.458164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b03cb-f18b-453a-803c-b510d93067ac None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:37.458641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b03cb-f18b-453a-803c-b510d93067ac None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:37.460746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 176/335] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:37.466826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221007d8-ad92-4512-bd9c-29373ee71c2b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:37.467810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221007d8-ad92-4512-bd9c-29373ee71c2b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:37.468282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221007d8-ad92-4512-bd9c-29373ee71c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:37.493523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-221007d8-ad92-4512-bd9c-29373ee71c2b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:37.494742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-221007d8-ad92-4512-bd9c-29373ee71c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:37.508653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:37.578388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 160/336] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:37.715646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1e7d-b774-4c67-a758-14a089df1a06 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:37.716336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1e7d-b774-4c67-a758-14a089df1a06 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:37.716819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1e7d-b774-4c67-a758-14a089df1a06 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:37.718618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 177/337] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:37.738264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a939-393c-4e14-b919-cb3f1d0f1b62 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:37.738910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a939-393c-4e14-b919-cb3f1d0f1b62 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:37.739377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a939-393c-4e14-b919-cb3f1d0f1b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:37.773468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-74c6a939-393c-4e14-b919-cb3f1d0f1b62 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:37.775434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-74c6a939-393c-4e14-b919-cb3f1d0f1b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:37.883820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 161/338] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:38.187079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad1e7d-b774-4c67-a758-14a089df1a06 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:38.296948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:38.337032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc78b-21c0-4b5d-88c0-e3a02da35602 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:38.337648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc78b-21c0-4b5d-88c0-e3a02da35602 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:38.338124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc78b-21c0-4b5d-88c0-e3a02da35602 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:38.340022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 162/339] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:38.343441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad1e7d-b774-4c67-a758-14a089df1a06 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:38.358370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434584c-a0bc-43e1-81ae-843d71b90ce5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:38.358976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434584c-a0bc-43e1-81ae-843d71b90ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:38.359444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434584c-a0bc-43e1-81ae-843d71b90ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:38.395780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aae7ca-eb00-4174-8d03-ea252ac9f1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:38.396293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae7ca-eb00-4174-8d03-ea252ac9f1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:38.396750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae7ca-eb00-4174-8d03-ea252ac9f1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:38.397173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae7ca-eb00-4174-8d03-ea252ac9f1a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:38.404949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3434584c-a0bc-43e1-81ae-843d71b90ce5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:38.406509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3434584c-a0bc-43e1-81ae-843d71b90ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:38.420944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aae7ca-eb00-4174-8d03-ea252ac9f1a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-14aae7ca-eb00-4174-8d03-ea252ac9f1a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:38.436232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:38.437225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:38.438152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 178/340] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:38.439606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc91c1-2ca9-44e0-9380-88f53118e9c3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:38.439606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc91c1-2ca9-44e0-9380-88f53118e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:38.439911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc91c1-2ca9-44e0-9380-88f53118e9c3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:38.445170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 179/341] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:38.446778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16b83-0741-4058-b261-89e9a674bc2a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:38.447214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16b83-0741-4058-b261-89e9a674bc2a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:38.447315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16b83-0741-4058-b261-89e9a674bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:38.470863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8da16b83-0741-4058-b261-89e9a674bc2a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:38.473341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8da16b83-0741-4058-b261-89e9a674bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:38.522948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 163/342] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:38.530551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434584c-a0bc-43e1-81ae-843d71b90ce5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:38.535577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:38.558241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 180/343] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:38.559528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da16b83-0741-4058-b261-89e9a674bc2a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:38.640200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:38.701704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da16b83-0741-4058-b261-89e9a674bc2a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:38.752103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434584c-a0bc-43e1-81ae-843d71b90ce5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:38.766495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18325e22-3b3e-44ae-adfa-21a38c13120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:38.767415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18325e22-3b3e-44ae-adfa-21a38c13120c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:38.767901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18325e22-3b3e-44ae-adfa-21a38c13120c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:38.768313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18325e22-3b3e-44ae-adfa-21a38c13120c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:38.791793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18325e22-3b3e-44ae-adfa-21a38c13120c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-18325e22-3b3e-44ae-adfa-21a38c13120c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:38.796947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:38.798105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:38.799489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:38.801909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 181/344] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:38.811981 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18325e22-3b3e-44ae-adfa-21a38c13120c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:38.813191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68b924-c34f-460b-bca1-4feb6935fabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:38.813852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68b924-c34f-460b-bca1-4feb6935fabb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:38.814243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68b924-c34f-460b-bca1-4feb6935fabb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:38.814739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68b924-c34f-460b-bca1-4feb6935fabb None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:38.819795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68b924-c34f-460b-bca1-4feb6935fabb None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:38.819795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68b924-c34f-460b-bca1-4feb6935fabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:38.819795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68b924-c34f-460b-bca1-4feb6935fabb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:38.832250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 164/345] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:38.842033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68b924-c34f-460b-bca1-4feb6935fabb None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:38.940212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:38.989838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68b924-c34f-460b-bca1-4feb6935fabb None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:39.040053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18325e22-3b3e-44ae-adfa-21a38c13120c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:39.062468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8233158-51d2-4ab4-9e14-f30608b0a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:39.062885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:39.063086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8233158-51d2-4ab4-9e14-f30608b0a15f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.063361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8233158-51d2-4ab4-9e14-f30608b0a15f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.064166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8233158-51d2-4ab4-9e14-f30608b0a15f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.098523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e4f55-327c-4d93-a066-281d8aa22188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:39.099200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e4f55-327c-4d93-a066-281d8aa22188 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.099471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e4f55-327c-4d93-a066-281d8aa22188 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.099777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e4f55-327c-4d93-a066-281d8aa22188 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.100438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e4f55-327c-4d93-a066-281d8aa22188 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:39.100735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e4f55-327c-4d93-a066-281d8aa22188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:39.102148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e4f55-327c-4d93-a066-281d8aa22188 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:39.121822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 182/346] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:39.122988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e4f55-327c-4d93-a066-281d8aa22188 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:39.176546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8233158-51d2-4ab4-9e14-f30608b0a15f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:39.178270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8233158-51d2-4ab4-9e14-f30608b0a15f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:39.258340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e4f55-327c-4d93-a066-281d8aa22188 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:39.270390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:39.314664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd92f-f309-45cc-9b7c-9bde4c096f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:39.315967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd92f-f309-45cc-9b7c-9bde4c096f95 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.316332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd92f-f309-45cc-9b7c-9bde4c096f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.316673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd92f-f309-45cc-9b7c-9bde4c096f95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.332244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 165/347] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:39.333752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8233158-51d2-4ab4-9e14-f30608b0a15f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:39.333923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6dd92f-f309-45cc-9b7c-9bde4c096f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ef6dd92f-f309-45cc-9b7c-9bde4c096f95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:39.346587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:39.347631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:39.349266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 183/348] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:39.350263 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd92f-f309-45cc-9b7c-9bde4c096f95 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:39.422389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:39.481965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8233158-51d2-4ab4-9e14-f30608b0a15f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:39.510559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd92f-f309-45cc-9b7c-9bde4c096f95 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:39.522516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcba6e-6c4c-43fd-9840-d3059bdff699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:39.522905 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcba6e-6c4c-43fd-9840-d3059bdff699 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.523179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcba6e-6c4c-43fd-9840-d3059bdff699 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.523699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcba6e-6c4c-43fd-9840-d3059bdff699 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.536230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcba6e-6c4c-43fd-9840-d3059bdff699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-9dbcba6e-6c4c-43fd-9840-d3059bdff699 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:39.542910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:39.543903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 166/349] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:39.545257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcba6e-6c4c-43fd-9840-d3059bdff699 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:39.580259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbee78e-ea78-4581-96fb-7aa6778d0cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:39.580468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:39.580900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbee78e-ea78-4581-96fb-7aa6778d0cee None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.581185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbee78e-ea78-4581-96fb-7aa6778d0cee None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.581454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbee78e-ea78-4581-96fb-7aa6778d0cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.693709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbee78e-ea78-4581-96fb-7aa6778d0cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:39.695255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbee78e-ea78-4581-96fb-7aa6778d0cee None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:39.695493 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcba6e-6c4c-43fd-9840-d3059bdff699 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:39.743469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:39.753207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f1656-8124-4209-96a6-40c97a5d5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:39.753675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f1656-8124-4209-96a6-40c97a5d5ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.754000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f1656-8124-4209-96a6-40c97a5d5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.754259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f1656-8124-4209-96a6-40c97a5d5ee5 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.755438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f1656-8124-4209-96a6-40c97a5d5ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:39.756885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f1656-8124-4209-96a6-40c97a5d5ee5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:39.760334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 167/350] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:39 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:39.761191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f1656-8124-4209-96a6-40c97a5d5ee5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:39.827708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 184/351] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:39.829081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe5db1-ebc0-4b0e-83c7-dc0d1a141940 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.829956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe5db1-ebc0-4b0e-83c7-dc0d1a141940 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.830310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe5db1-ebc0-4b0e-83c7-dc0d1a141940 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.832832 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 185/352] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:39.833689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe5db1-ebc0-4b0e-83c7-dc0d1a141940 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:39.906871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:39.916104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f1656-8124-4209-96a6-40c97a5d5ee5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:39.961842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2362-b9d2-470a-86ab-c4f9063b7757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:39.962078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2362-b9d2-470a-86ab-c4f9063b7757 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.962409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2362-b9d2-470a-86ab-c4f9063b7757 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.962758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2362-b9d2-470a-86ab-c4f9063b7757 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.963912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2362-b9d2-470a-86ab-c4f9063b7757 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:39.963912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2362-b9d2-470a-86ab-c4f9063b7757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:39.965218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2362-b9d2-470a-86ab-c4f9063b7757 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:39.968766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe5db1-ebc0-4b0e-83c7-dc0d1a141940 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:39.976457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 168/353] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:39.977433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2362-b9d2-470a-86ab-c4f9063b7757 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:40.021319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0cca4-3658-43c7-8982-ec6e4aac5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:40.022186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0cca4-3658-43c7-8982-ec6e4aac5dfd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.022459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0cca4-3658-43c7-8982-ec6e4aac5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.022722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0cca4-3658-43c7-8982-ec6e4aac5dfd None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.023389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0cca4-3658-43c7-8982-ec6e4aac5dfd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:40.023684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0cca4-3658-43c7-8982-ec6e4aac5dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:40.025321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0cca4-3658-43c7-8982-ec6e4aac5dfd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:40.030795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:40.035097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 186/354] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:40.036394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0903da8-2470-4e44-a901-f8107064b15f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.036660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0903da8-2470-4e44-a901-f8107064b15f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.036985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0903da8-2470-4e44-a901-f8107064b15f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.038160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 187/355] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:40.040654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0903da8-2470-4e44-a901-f8107064b15f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:40.135911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2362-b9d2-470a-86ab-c4f9063b7757 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:40.161911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0903da8-2470-4e44-a901-f8107064b15f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:40.188394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d831b-3df8-43d1-bb83-875d9251edcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:40.189265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d831b-3df8-43d1-bb83-875d9251edcb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.189764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d831b-3df8-43d1-bb83-875d9251edcb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.190193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d831b-3df8-43d1-bb83-875d9251edcb None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.201412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d831b-3df8-43d1-bb83-875d9251edcb None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:40.203502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d831b-3df8-43d1-bb83-875d9251edcb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:40.206024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 169/356] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:39 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:40.211970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594422e-79f8-4150-9a41-51531e74f06d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.211970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594422e-79f8-4150-9a41-51531e74f06d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.211970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594422e-79f8-4150-9a41-51531e74f06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.216673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd19ca-7e1a-4618-96b5-4f16e522923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:40.217400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd19ca-7e1a-4618-96b5-4f16e522923e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.217737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd19ca-7e1a-4618-96b5-4f16e522923e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.218075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd19ca-7e1a-4618-96b5-4f16e522923e None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.219439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd19ca-7e1a-4618-96b5-4f16e522923e None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:40.223132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd19ca-7e1a-4618-96b5-4f16e522923e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:40.228786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 188/357] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:40 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:40.228786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd19ca-7e1a-4618-96b5-4f16e522923e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:40.231196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c594422e-79f8-4150-9a41-51531e74f06d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:40.232550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c594422e-79f8-4150-9a41-51531e74f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:40.249252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:40.305770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:40.333062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 170/358] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:40.333939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594422e-79f8-4150-9a41-51531e74f06d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:40.357768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd19ca-7e1a-4618-96b5-4f16e522923e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:40.414683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702f18-974f-4f91-a7ca-8f90bb9dd435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:40.415326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702f18-974f-4f91-a7ca-8f90bb9dd435 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.415624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702f18-974f-4f91-a7ca-8f90bb9dd435 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.416192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702f18-974f-4f91-a7ca-8f90bb9dd435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.483955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594422e-79f8-4150-9a41-51531e74f06d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:40.531830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf117bf-bf71-4790-867c-92e646ab8d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:40.532602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702f18-974f-4f91-a7ca-8f90bb9dd435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:40.533273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf117bf-bf71-4790-867c-92e646ab8d9b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.533549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf117bf-bf71-4790-867c-92e646ab8d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.533817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf117bf-bf71-4790-867c-92e646ab8d9b None admin] PATH_INFO: `/v3/users/fe43e3095f7b4e9c8726db925948a3b9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.534156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702f18-974f-4f91-a7ca-8f90bb9dd435 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:40.534995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf117bf-bf71-4790-867c-92e646ab8d9b None admin] RBAC: Authorizing `identity:get_user(user_id=fe43e3095f7b4e9c8726db925948a3b9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:40.536448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf117bf-bf71-4790-867c-92e646ab8d9b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:40.538029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 171/359] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 10:58:40 2022] GET /identity/v3/users/fe43e3095f7b4e9c8726db925948a3b9 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:40.539383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc80db-0af7-452b-a09e-c8eff008da28 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.539638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc80db-0af7-452b-a09e-c8eff008da28 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.539949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc80db-0af7-452b-a09e-c8eff008da28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.564901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-cafc80db-0af7-452b-a09e-c8eff008da28 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:40.566226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cafc80db-0af7-452b-a09e-c8eff008da28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:40.589419 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:40.634598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:40.669094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 172/360] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:40.671089 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc80db-0af7-452b-a09e-c8eff008da28 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:40.677468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 189/361] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:40.678423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702f18-974f-4f91-a7ca-8f90bb9dd435 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:40.829512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702f18-974f-4f91-a7ca-8f90bb9dd435 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:40.842832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc80db-0af7-452b-a09e-c8eff008da28 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:40.879120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b3e0e-0c42-4353-bad0-c4d14009b9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:40.880573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b3e0e-0c42-4353-bad0-c4d14009b9bd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.880853 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b3e0e-0c42-4353-bad0-c4d14009b9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.881125 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b3e0e-0c42-4353-bad0-c4d14009b9bd None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.883914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b3e0e-0c42-4353-bad0-c4d14009b9bd None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:40.884156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b3e0e-0c42-4353-bad0-c4d14009b9bd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:40.885920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 190/362] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:40 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:40.886628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b3e0e-0c42-4353-bad0-c4d14009b9bd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:40.888078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268b16d-4b5d-4e3d-b30f-f68af2c319d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:40.889479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b16d-4b5d-4e3d-b30f-f68af2c319d8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:40.889948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b16d-4b5d-4e3d-b30f-f68af2c319d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:40.890408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b16d-4b5d-4e3d-b30f-f68af2c319d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:40.891321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268b16d-4b5d-4e3d-b30f-f68af2c319d8 None admin] RBAC: Adding query filter params (group.id=a49b056985924ec1b2148a47d53e044a, role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:40.891975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268b16d-4b5d-4e3d-b30f-f68af2c319d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:40.893745 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268b16d-4b5d-4e3d-b30f-f68af2c319d8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:40.908676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 173/363] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:40 2022] GET /identity/v3/role_assignments?group.id=a49b056985924ec1b2148a47d53e044a&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:40.908676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268b16d-4b5d-4e3d-b30f-f68af2c319d8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:40.931199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:40.952589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:41.057389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b3e0e-0c42-4353-bad0-c4d14009b9bd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:41.058580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268b16d-4b5d-4e3d-b30f-f68af2c319d8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:41.101903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52fcad-b02f-449a-a7ef-693c8d619053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:41.102185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ff87-aab0-4213-8862-d6cc4ec8cffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:41.102463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52fcad-b02f-449a-a7ef-693c8d619053 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:41.102571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ff87-aab0-4213-8862-d6cc4ec8cffe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:41.102741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52fcad-b02f-449a-a7ef-693c8d619053 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:41.102840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ff87-aab0-4213-8862-d6cc4ec8cffe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:41.103008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ff87-aab0-4213-8862-d6cc4ec8cffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:41.103108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52fcad-b02f-449a-a7ef-693c8d619053 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:41.103822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ff87-aab0-4213-8862-d6cc4ec8cffe None admin] RBAC: Adding query filter params (role.id=59ee78b0895446c0b5244158b1252b64, user.id=fe43e3095f7b4e9c8726db925948a3b9, scope.system=all) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:41.104136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ff87-aab0-4213-8862-d6cc4ec8cffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:41.105593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ff87-aab0-4213-8862-d6cc4ec8cffe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:41.114706 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52fcad-b02f-449a-a7ef-693c8d619053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4f52fcad-b02f-449a-a7ef-693c8d619053 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:41.121067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:41.122355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:41.123570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 174/364] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:41.124678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 191/365] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Aug 31 10:58:40 2022] GET /identity/v3/role_assignments?user.id=fe43e3095f7b4e9c8726db925948a3b9&scope.system=all&role.id=59ee78b0895446c0b5244158b1252b64 => generated 510 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:41.124759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52fcad-b02f-449a-a7ef-693c8d619053 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:41.124838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ff87-aab0-4213-8862-d6cc4ec8cffe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:41.217589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:41.255581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52fcad-b02f-449a-a7ef-693c8d619053 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:41.262393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:41.271705 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ff87-aab0-4213-8862-d6cc4ec8cffe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:41.297172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fe9eb-875f-4777-9ab4-5eee569d4181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:41.298041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fe9eb-875f-4777-9ab4-5eee569d4181 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:41.298420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fe9eb-875f-4777-9ab4-5eee569d4181 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:41.299212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fe9eb-875f-4777-9ab4-5eee569d4181 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:41.300817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fe9eb-875f-4777-9ab4-5eee569d4181 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:41.302414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fe9eb-875f-4777-9ab4-5eee569d4181 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:41.305340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 175/366] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:41 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:41.306231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fe9eb-875f-4777-9ab4-5eee569d4181 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:41.343657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6cdbc-592c-4d13-8543-0880f9134b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:41.344311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6cdbc-592c-4d13-8543-0880f9134b26 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:41.344591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6cdbc-592c-4d13-8543-0880f9134b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:41.344916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6cdbc-592c-4d13-8543-0880f9134b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:41.346050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6cdbc-592c-4d13-8543-0880f9134b26 None admin] RBAC: Adding query filter params (group.id=a49b056985924ec1b2148a47d53e044a, role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:41.346403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6cdbc-592c-4d13-8543-0880f9134b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:41.347918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6cdbc-592c-4d13-8543-0880f9134b26 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:41.356744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 192/367] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:41 2022] GET /identity/v3/role_assignments?group.id=a49b056985924ec1b2148a47d53e044a&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:41.357407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6cdbc-592c-4d13-8543-0880f9134b26 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:41.470004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fe9eb-875f-4777-9ab4-5eee569d4181 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:41.526826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53d1ed-bf5f-48b2-a07e-45a03643c2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:41.527492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53d1ed-bf5f-48b2-a07e-45a03643c2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:41.527964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53d1ed-bf5f-48b2-a07e-45a03643c2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:41.528386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53d1ed-bf5f-48b2-a07e-45a03643c2f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:41.537463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6cdbc-592c-4d13-8543-0880f9134b26 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:41.540314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:41.545303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53d1ed-bf5f-48b2-a07e-45a03643c2f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-7f53d1ed-bf5f-48b2-a07e-45a03643c2f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:41.552729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:41.558860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 176/368] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:41.560100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53d1ed-bf5f-48b2-a07e-45a03643c2f3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:41.591079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01332648-b43d-4b9f-9ef7-e284dea8c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:41.591701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01332648-b43d-4b9f-9ef7-e284dea8c16b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:41.592007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01332648-b43d-4b9f-9ef7-e284dea8c16b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:41.592280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01332648-b43d-4b9f-9ef7-e284dea8c16b None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:41.592958 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01332648-b43d-4b9f-9ef7-e284dea8c16b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:41.593266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01332648-b43d-4b9f-9ef7-e284dea8c16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:41.594694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01332648-b43d-4b9f-9ef7-e284dea8c16b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:41.604939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 193/369] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:41.605879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01332648-b43d-4b9f-9ef7-e284dea8c16b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:41.637762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:41.706815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53d1ed-bf5f-48b2-a07e-45a03643c2f3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:41.754589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc43da-780a-43b6-bfac-409f0eedcace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:41.755263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc43da-780a-43b6-bfac-409f0eedcace None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:41.755542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc43da-780a-43b6-bfac-409f0eedcace None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:41.755859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc43da-780a-43b6-bfac-409f0eedcace None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:41.757508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc43da-780a-43b6-bfac-409f0eedcace None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:41.759118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc43da-780a-43b6-bfac-409f0eedcace None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:41.761129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 177/370] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:41 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:41.761921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc43da-780a-43b6-bfac-409f0eedcace None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:41.770068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01332648-b43d-4b9f-9ef7-e284dea8c16b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:41.811257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded70e7-fc39-4c2f-ad42-6762e92f6f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:41.811917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded70e7-fc39-4c2f-ad42-6762e92f6f02 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:41.812208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded70e7-fc39-4c2f-ad42-6762e92f6f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:41.812538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded70e7-fc39-4c2f-ad42-6762e92f6f02 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:41.813254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded70e7-fc39-4c2f-ad42-6762e92f6f02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:41.814240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded70e7-fc39-4c2f-ad42-6762e92f6f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:41.815938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded70e7-fc39-4c2f-ad42-6762e92f6f02 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:41.825245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 194/371] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:41.826112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded70e7-fc39-4c2f-ad42-6762e92f6f02 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:41.867118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:41.942124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc43da-780a-43b6-bfac-409f0eedcace None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:41.990005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:42.011198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25ef2b-9482-4582-8040-a90cb190048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:42.012348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25ef2b-9482-4582-8040-a90cb190048e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:42.013295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25ef2b-9482-4582-8040-a90cb190048e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:42.013781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25ef2b-9482-4582-8040-a90cb190048e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:42.016143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded70e7-fc39-4c2f-ad42-6762e92f6f02 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:42.073601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d902109-e0f4-4b69-b1fa-1fa211f76c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:42.074369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d902109-e0f4-4b69-b1fa-1fa211f76c31 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:42.074744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d902109-e0f4-4b69-b1fa-1fa211f76c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:42.075115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d902109-e0f4-4b69-b1fa-1fa211f76c31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:42.075989 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d902109-e0f4-4b69-b1fa-1fa211f76c31 None admin] RBAC: Adding query filter params (group.id=a49b056985924ec1b2148a47d53e044a, role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:42.076653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d902109-e0f4-4b69-b1fa-1fa211f76c31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:42.079221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d902109-e0f4-4b69-b1fa-1fa211f76c31 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:42.086067 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 195/372] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:41 2022] GET /identity/v3/role_assignments?group.id=a49b056985924ec1b2148a47d53e044a&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:42.087017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d902109-e0f4-4b69-b1fa-1fa211f76c31 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:42.172511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25ef2b-9482-4582-8040-a90cb190048e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:42.175464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25ef2b-9482-4582-8040-a90cb190048e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:42.229986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d902109-e0f4-4b69-b1fa-1fa211f76c31 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:42.294075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72a2f1-18e1-4c0f-ba74-3d658332ea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:42.294451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72a2f1-18e1-4c0f-ba74-3d658332ea2d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:42.294733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72a2f1-18e1-4c0f-ba74-3d658332ea2d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:42.295008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72a2f1-18e1-4c0f-ba74-3d658332ea2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:42.306605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:42.316729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:42.347197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 178/373] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:42.353008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25ef2b-9482-4582-8040-a90cb190048e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:42.435303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72a2f1-18e1-4c0f-ba74-3d658332ea2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:42.440371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72a2f1-18e1-4c0f-ba74-3d658332ea2d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:42.559120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 196/374] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:42.564893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72a2f1-18e1-4c0f-ba74-3d658332ea2d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:42.565764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25ef2b-9482-4582-8040-a90cb190048e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:42.624558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:42.637635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15841ce8-900b-4658-9139-8ce8af221b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:42.652235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15841ce8-900b-4658-9139-8ce8af221b74 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:42.652235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15841ce8-900b-4658-9139-8ce8af221b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:42.652235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15841ce8-900b-4658-9139-8ce8af221b74 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:42.652235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15841ce8-900b-4658-9139-8ce8af221b74 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:42.652235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15841ce8-900b-4658-9139-8ce8af221b74 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:42.652235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 179/375] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:42 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:42.653069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15841ce8-900b-4658-9139-8ce8af221b74 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:42.690146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72a2f1-18e1-4c0f-ba74-3d658332ea2d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:42.734026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d7d25-b233-499e-aed1-95d48a3ffd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:42.734678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d7d25-b233-499e-aed1-95d48a3ffd07 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:42.734953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d7d25-b233-499e-aed1-95d48a3ffd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:42.735222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d7d25-b233-499e-aed1-95d48a3ffd07 None admin] PATH_INFO: `/v3/projects/fa445d84b8134f39a7735cb2fc7c685b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:42.737804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d7d25-b233-499e-aed1-95d48a3ffd07 None admin] RBAC: Authorizing `identity:get_project(project_id=fa445d84b8134f39a7735cb2fc7c685b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:42.739267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d7d25-b233-499e-aed1-95d48a3ffd07 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:42.743119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 197/376] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:42 2022] GET /identity/v3/projects/fa445d84b8134f39a7735cb2fc7c685b => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:42.753295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d7d25-b233-499e-aed1-95d48a3ffd07 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:42.759399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:42.881136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15841ce8-900b-4658-9139-8ce8af221b74 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:42.922146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d185-ae4e-45af-bd43-b8f6a0fea06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:42.922796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d185-ae4e-45af-bd43-b8f6a0fea06d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:42.923922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d185-ae4e-45af-bd43-b8f6a0fea06d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:42.924285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d185-ae4e-45af-bd43-b8f6a0fea06d None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:42.925779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d185-ae4e-45af-bd43-b8f6a0fea06d None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:42.927257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d185-ae4e-45af-bd43-b8f6a0fea06d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:42.930424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 180/377] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:42 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:42.936446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d185-ae4e-45af-bd43-b8f6a0fea06d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:42.984111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d7d25-b233-499e-aed1-95d48a3ffd07 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:43.007580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:43.053756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6f66f-9729-40dd-bc60-7b1d3b219017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:43.054402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6f66f-9729-40dd-bc60-7b1d3b219017 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:43.054681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6f66f-9729-40dd-bc60-7b1d3b219017 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:43.054952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6f66f-9729-40dd-bc60-7b1d3b219017 None admin] PATH_INFO: `/v3/groups/bcda3cb5fa144b4e9cd5cb1ccd4c602c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:43.068094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6f66f-9729-40dd-bc60-7b1d3b219017 None admin] RBAC: Authorizing `identity:get_group(group_id=bcda3cb5fa144b4e9cd5cb1ccd4c602c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:43.069569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6f66f-9729-40dd-bc60-7b1d3b219017 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:43.073962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 198/378] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:42 2022] GET /identity/v3/groups/bcda3cb5fa144b4e9cd5cb1ccd4c602c => generated 229 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:43.080751 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6f66f-9729-40dd-bc60-7b1d3b219017 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:43.124774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d185-ae4e-45af-bd43-b8f6a0fea06d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:43.127571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:43.165323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07a53c-6bc2-4777-a303-498a6c9d70c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:43.165840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07a53c-6bc2-4777-a303-498a6c9d70c6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:43.166122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07a53c-6bc2-4777-a303-498a6c9d70c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:43.166514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07a53c-6bc2-4777-a303-498a6c9d70c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:43.167999 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07a53c-6bc2-4777-a303-498a6c9d70c6 None admin] RBAC: Adding query filter params (group.id=a49b056985924ec1b2148a47d53e044a, role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:43.168317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07a53c-6bc2-4777-a303-498a6c9d70c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:43.169804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07a53c-6bc2-4777-a303-498a6c9d70c6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:43.176316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 181/379] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:42 2022] GET /identity/v3/role_assignments?group.id=a49b056985924ec1b2148a47d53e044a&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:43.281159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6f66f-9729-40dd-bc60-7b1d3b219017 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:43.321408 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eca21-5939-478c-a46d-6cf6678a5f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:43.322023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eca21-5939-478c-a46d-6cf6678a5f61 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:43.322296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eca21-5939-478c-a46d-6cf6678a5f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:43.322566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eca21-5939-478c-a46d-6cf6678a5f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:43.323295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eca21-5939-478c-a46d-6cf6678a5f61 None admin] RBAC: Adding query filter params (group.id=bcda3cb5fa144b4e9cd5cb1ccd4c602c, role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=fa445d84b8134f39a7735cb2fc7c685b) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:43.323597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eca21-5939-478c-a46d-6cf6678a5f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:43.325213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eca21-5939-478c-a46d-6cf6678a5f61 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:43.332433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 199/380] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:43 2022] GET /identity/v3/role_assignments?group.id=bcda3cb5fa144b4e9cd5cb1ccd4c602c&scope.project.id=fa445d84b8134f39a7735cb2fc7c685b&role.id=55aed406476a485f99f9815f9f27cb3b => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:43.367311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8321593-2c42-4599-b02f-b2837e88746e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:43.367679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8321593-2c42-4599-b02f-b2837e88746e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:43.367925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8321593-2c42-4599-b02f-b2837e88746e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:43.369753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 182/381] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:43.375485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9117ad0-24a7-4e7c-8830-14099f651b22 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:43.375812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9117ad0-24a7-4e7c-8830-14099f651b22 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:43.376655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9117ad0-24a7-4e7c-8830-14099f651b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:43.405827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b9117ad0-24a7-4e7c-8830-14099f651b22 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:43.407198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b9117ad0-24a7-4e7c-8830-14099f651b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:43.467862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:43.507493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 200/382] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:43.838674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec55469-5cd0-486f-9150-dee059264d19 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:43.839511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec55469-5cd0-486f-9150-dee059264d19 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:43.839956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec55469-5cd0-486f-9150-dee059264d19 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:43.841441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 183/383] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:43.864258 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6af5d-a3e5-43ca-ba53-391706264b30 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:43.864779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6af5d-a3e5-43ca-ba53-391706264b30 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:43.864883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6af5d-a3e5-43ca-ba53-391706264b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:43.889836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-44f6af5d-a3e5-43ca-ba53-391706264b30 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:43.891151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-44f6af5d-a3e5-43ca-ba53-391706264b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:43.953085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec55469-5cd0-486f-9150-dee059264d19 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:43.980526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 201/384] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:44.091951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec55469-5cd0-486f-9150-dee059264d19 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:44.131409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d2d00-613d-431d-9a27-4545b534999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:44.132082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2d00-613d-431d-9a27-4545b534999a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:44.132361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2d00-613d-431d-9a27-4545b534999a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:44.132635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2d00-613d-431d-9a27-4545b534999a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:44.145053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d2d00-613d-431d-9a27-4545b534999a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-c60d2d00-613d-431d-9a27-4545b534999a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:44.150213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:44.152309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:44.154244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 184/385] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:44.161059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6af5d-a3e5-43ca-ba53-391706264b30 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:44.293229 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6af5d-a3e5-43ca-ba53-391706264b30 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:44.294829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:44.335594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf76e57-5bc5-48ac-826f-da7d604d385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:44.336242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf76e57-5bc5-48ac-826f-da7d604d385a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:44.336519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf76e57-5bc5-48ac-826f-da7d604d385a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:44.336793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf76e57-5bc5-48ac-826f-da7d604d385a None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:44.337467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf76e57-5bc5-48ac-826f-da7d604d385a None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:44.337771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf76e57-5bc5-48ac-826f-da7d604d385a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:44.339224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf76e57-5bc5-48ac-826f-da7d604d385a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:44.349200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 202/386] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:44.356850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d2d00-613d-431d-9a27-4545b534999a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:44.389286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:44.436557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf76e57-5bc5-48ac-826f-da7d604d385a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:44.478052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d2d00-613d-431d-9a27-4545b534999a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:44.538540 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119c3ee-6a82-45a0-80bf-7623dc2a113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:44.540052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119c3ee-6a82-45a0-80bf-7623dc2a113e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:44.540773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119c3ee-6a82-45a0-80bf-7623dc2a113e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:44.541489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119c3ee-6a82-45a0-80bf-7623dc2a113e None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:44.549118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119c3ee-6a82-45a0-80bf-7623dc2a113e None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:44.552063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119c3ee-6a82-45a0-80bf-7623dc2a113e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:44.563773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 185/387] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:44 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:44.564983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119c3ee-6a82-45a0-80bf-7623dc2a113e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:44.565339 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf76e57-5bc5-48ac-826f-da7d604d385a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:44.608846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5603c-be71-40b5-a69a-d3e664230f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:44.609838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5603c-be71-40b5-a69a-d3e664230f59 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:44.610115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5603c-be71-40b5-a69a-d3e664230f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:44.610598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5603c-be71-40b5-a69a-d3e664230f59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:44.627297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5603c-be71-40b5-a69a-d3e664230f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-23a5603c-be71-40b5-a69a-d3e664230f59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:44.634449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:44.635387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:44.636211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 203/388] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:44.645421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5603c-be71-40b5-a69a-d3e664230f59 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:44.678574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:44.738243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119c3ee-6a82-45a0-80bf-7623dc2a113e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:44.760216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:44.779483 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5603c-be71-40b5-a69a-d3e664230f59 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:44.780122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd8900-3eb8-4ffd-805a-d4a6486f2036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:44.780976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd8900-3eb8-4ffd-805a-d4a6486f2036 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:44.781480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd8900-3eb8-4ffd-805a-d4a6486f2036 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:44.781958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd8900-3eb8-4ffd-805a-d4a6486f2036 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:44.784174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd8900-3eb8-4ffd-805a-d4a6486f2036 None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:44.785821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd8900-3eb8-4ffd-805a-d4a6486f2036 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:44.787673 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 186/389] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:44 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:44.789152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ad12-c4a2-4e38-998b-9bbf37460977 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:44.789677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ad12-c4a2-4e38-998b-9bbf37460977 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:44.790218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ad12-c4a2-4e38-998b-9bbf37460977 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:44.791705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 187/390] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:44.797605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e8266-5081-411c-8b9b-08f26fda687f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:44.798219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e8266-5081-411c-8b9b-08f26fda687f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:44.798706 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e8266-5081-411c-8b9b-08f26fda687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:44.823514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-719e8266-5081-411c-8b9b-08f26fda687f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:44.825165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-719e8266-5081-411c-8b9b-08f26fda687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:44.825286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c9be1-d993-4c70-8212-2fb4b0b164ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:44.825858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c9be1-d993-4c70-8212-2fb4b0b164ec None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:44.826192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c9be1-d993-4c70-8212-2fb4b0b164ec None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:44.826467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c9be1-d993-4c70-8212-2fb4b0b164ec None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:44.827138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c9be1-d993-4c70-8212-2fb4b0b164ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:44.827438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c9be1-d993-4c70-8212-2fb4b0b164ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:44.828932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c9be1-d993-4c70-8212-2fb4b0b164ec None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:44.842980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 204/391] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:44.842980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c9be1-d993-4c70-8212-2fb4b0b164ec None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:44.919658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 188/392] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:44.921402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e8266-5081-411c-8b9b-08f26fda687f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:44.986989 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:45.021722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c9be1-d993-4c70-8212-2fb4b0b164ec None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:45.072241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:45.080399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e8266-5081-411c-8b9b-08f26fda687f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:45.112840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf53ec-fc43-49b9-af23-cec14f3b75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:45.113610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf53ec-fc43-49b9-af23-cec14f3b75db None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.113888 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf53ec-fc43-49b9-af23-cec14f3b75db None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.114231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf53ec-fc43-49b9-af23-cec14f3b75db None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/groups/a49b056985924ec1b2148a47d53e044a/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf53ec-fc43-49b9-af23-cec14f3b75db None admin] RBAC: Authorizing `identity:create_grant(project_id=3c595f0dd4dc4be48e21e5267bea2ccc, group_id=a49b056985924ec1b2148a47d53e044a, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:45.118779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf53ec-fc43-49b9-af23-cec14f3b75db None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:45.127139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d26917-fb72-405e-897c-8efafba0927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:45.132715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d26917-fb72-405e-897c-8efafba0927c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.132715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d26917-fb72-405e-897c-8efafba0927c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.132715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d26917-fb72-405e-897c-8efafba0927c None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.132715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d26917-fb72-405e-897c-8efafba0927c None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:45.132715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d26917-fb72-405e-897c-8efafba0927c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:45.133227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 189/393] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:44 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:45.138535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d26917-fb72-405e-897c-8efafba0927c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:45.231774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 205/394] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Aug 31 10:58:44 2022] PUT /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/groups/a49b056985924ec1b2148a47d53e044a/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:45.271474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d26917-fb72-405e-897c-8efafba0927c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:45.342897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c6fa7-21e1-4e0a-9e79-b547e713ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:45.343565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c6fa7-21e1-4e0a-9e79-b547e713ff9b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.343881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c6fa7-21e1-4e0a-9e79-b547e713ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.344153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c6fa7-21e1-4e0a-9e79-b547e713ff9b None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.345476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c6fa7-21e1-4e0a-9e79-b547e713ff9b None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:45.346978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c6fa7-21e1-4e0a-9e79-b547e713ff9b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:45.349159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 190/395] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:45 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:45.355079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf53ec-fc43-49b9-af23-cec14f3b75db None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:45.387314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c6fa7-21e1-4e0a-9e79-b547e713ff9b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:45.427482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:45.511481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c6fa7-21e1-4e0a-9e79-b547e713ff9b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:45.525328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf53ec-fc43-49b9-af23-cec14f3b75db None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:45.559528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30a3ee-ff6f-4638-96ef-66e06a330def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:45.560404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a3ee-ff6f-4638-96ef-66e06a330def None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.560678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a3ee-ff6f-4638-96ef-66e06a330def None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.560944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a3ee-ff6f-4638-96ef-66e06a330def None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.578457 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b300ac1-82cb-4966-a0bb-efc5d5d481b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:45.579528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b300ac1-82cb-4966-a0bb-efc5d5d481b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.579528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b300ac1-82cb-4966-a0bb-efc5d5d481b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.579695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b300ac1-82cb-4966-a0bb-efc5d5d481b3 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/groups/a49b056985924ec1b2148a47d53e044a/roles/ff90bae50e0644739e4bdec7431da2e0` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.581142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30a3ee-ff6f-4638-96ef-66e06a330def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4d30a3ee-ff6f-4638-96ef-66e06a330def None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:45.585995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:45.586875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:45.588145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 191/396] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:45.589084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b300ac1-82cb-4966-a0bb-efc5d5d481b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c595f0dd4dc4be48e21e5267bea2ccc, group_id=a49b056985924ec1b2148a47d53e044a, role_id=ff90bae50e0644739e4bdec7431da2e0)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:45.590500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b300ac1-82cb-4966-a0bb-efc5d5d481b3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:45.593161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30a3ee-ff6f-4638-96ef-66e06a330def None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:45.690436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 206/397] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Aug 31 10:58:45 2022] PUT /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc/groups/a49b056985924ec1b2148a47d53e044a/roles/ff90bae50e0644739e4bdec7431da2e0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:45.721423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949d4f-6d12-4dd2-b56f-cde0316d061d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.721741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949d4f-6d12-4dd2-b56f-cde0316d061d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.722005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949d4f-6d12-4dd2-b56f-cde0316d061d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.724309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 207/398] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:58:45.731111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a794-fddc-4baa-87ab-6e9587ba712a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.731431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a794-fddc-4baa-87ab-6e9587ba712a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.731678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a794-fddc-4baa-87ab-6e9587ba712a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.733557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 208/399] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:45.733865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:45.734811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad449b-75dd-43c5-95cc-351e8c0fba2e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.735113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad449b-75dd-43c5-95cc-351e8c0fba2e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.736035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad449b-75dd-43c5-95cc-351e8c0fba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.748426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30a3ee-ff6f-4638-96ef-66e06a330def None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:45.750147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:45.757203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b4ad449b-75dd-43c5-95cc-351e8c0fba2e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:45.758766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b4ad449b-75dd-43c5-95cc-351e8c0fba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:45.799862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993be043-2e08-4c1a-a861-cd6369cda0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:45.800606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993be043-2e08-4c1a-a861-cd6369cda0ff None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.800960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993be043-2e08-4c1a-a861-cd6369cda0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.805805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993be043-2e08-4c1a-a861-cd6369cda0ff None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.805805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993be043-2e08-4c1a-a861-cd6369cda0ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:45.805805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993be043-2e08-4c1a-a861-cd6369cda0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:45.805805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993be043-2e08-4c1a-a861-cd6369cda0ff None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:45.815579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 192/400] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:45.817145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846fef9-46cf-4db1-bf18-6c2edef0eba3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.817547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846fef9-46cf-4db1-bf18-6c2edef0eba3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.817993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846fef9-46cf-4db1-bf18-6c2edef0eba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.843141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3846fef9-46cf-4db1-bf18-6c2edef0eba3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:45.843141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3846fef9-46cf-4db1-bf18-6c2edef0eba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:45.859174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 209/401] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:45.860099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad449b-75dd-43c5-95cc-351e8c0fba2e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:45.943255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 193/402] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:45.998016 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad449b-75dd-43c5-95cc-351e8c0fba2e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:46.058499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4a159-225a-454e-9802-1cedf8f6c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:46.060056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4a159-225a-454e-9802-1cedf8f6c035 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:46.060837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4a159-225a-454e-9802-1cedf8f6c035 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:46.061554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4a159-225a-454e-9802-1cedf8f6c035 None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:46.064798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4a159-225a-454e-9802-1cedf8f6c035 None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:46.066541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4a159-225a-454e-9802-1cedf8f6c035 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:46.068440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 210/403] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:45 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:46.074006 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846fef9-46cf-4db1-bf18-6c2edef0eba3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:46.153617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4a159-225a-454e-9802-1cedf8f6c035 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:46.158852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:46.253582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:46.284790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846fef9-46cf-4db1-bf18-6c2edef0eba3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:46.340933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198328e-083c-456e-91d9-003be3616e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:46.341492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198328e-083c-456e-91d9-003be3616e9d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:46.341777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198328e-083c-456e-91d9-003be3616e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:46.342059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198328e-083c-456e-91d9-003be3616e9d None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:46.343639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198328e-083c-456e-91d9-003be3616e9d None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:46.345718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198328e-083c-456e-91d9-003be3616e9d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:46.346828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4a159-225a-454e-9802-1cedf8f6c035 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:46.347735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 194/404] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:46 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:46.348563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198328e-083c-456e-91d9-003be3616e9d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:46.388163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47076b6d-1c4a-4f78-9425-545b7a932f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:46.389251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47076b6d-1c4a-4f78-9425-545b7a932f4a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:46.389738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47076b6d-1c4a-4f78-9425-545b7a932f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:46.390213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47076b6d-1c4a-4f78-9425-545b7a932f4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:46.403871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47076b6d-1c4a-4f78-9425-545b7a932f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-47076b6d-1c4a-4f78-9425-545b7a932f4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:46.410480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:46.411542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:46.412712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:46.415143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 211/405] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:46.421146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47076b6d-1c4a-4f78-9425-545b7a932f4a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:46.469700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198328e-083c-456e-91d9-003be3616e9d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:46.509119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251c16f-022c-4217-8182-c0c6f278b061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:46.510147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251c16f-022c-4217-8182-c0c6f278b061 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:46.510628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251c16f-022c-4217-8182-c0c6f278b061 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:46.511113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251c16f-022c-4217-8182-c0c6f278b061 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:46.512155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:46.524639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251c16f-022c-4217-8182-c0c6f278b061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-b251c16f-022c-4217-8182-c0c6f278b061 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:46.533741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:46.534607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 195/406] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:58:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:46.535396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251c16f-022c-4217-8182-c0c6f278b061 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:46.550670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:46.560560 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47076b6d-1c4a-4f78-9425-545b7a932f4a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:46.608657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a232-702d-4b20-9369-fe160c23e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:46.609239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a232-702d-4b20-9369-fe160c23e073 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:46.609514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a232-702d-4b20-9369-fe160c23e073 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:46.609788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a232-702d-4b20-9369-fe160c23e073 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/groups/a49b056985924ec1b2148a47d53e044a/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:46.611835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41a232-702d-4b20-9369-fe160c23e073 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ee0bb518b41478ab6403f510bfebe, group_id=a49b056985924ec1b2148a47d53e044a, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:46.613564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41a232-702d-4b20-9369-fe160c23e073 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:46.668070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251c16f-022c-4217-8182-c0c6f278b061 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:46.707790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 212/407] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Aug 31 10:58:46 2022] PUT /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/groups/a49b056985924ec1b2148a47d53e044a/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:46.707790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a232-702d-4b20-9369-fe160c23e073 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:46.784831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce339c-70ea-4b4e-9ff4-545fbe6e50bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:46.785415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce339c-70ea-4b4e-9ff4-545fbe6e50bc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:46.785788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce339c-70ea-4b4e-9ff4-545fbe6e50bc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:46.786109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce339c-70ea-4b4e-9ff4-545fbe6e50bc None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:46.786990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce339c-70ea-4b4e-9ff4-545fbe6e50bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:46.787340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce339c-70ea-4b4e-9ff4-545fbe6e50bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:46.789014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce339c-70ea-4b4e-9ff4-545fbe6e50bc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:46.809615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 196/408] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:46.828590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce339c-70ea-4b4e-9ff4-545fbe6e50bc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:46.867847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a232-702d-4b20-9369-fe160c23e073 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:46.900564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:46.915214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c598-2eb5-4408-8afd-0beb50f3bace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:46.916296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c598-2eb5-4408-8afd-0beb50f3bace None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:46.917139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c598-2eb5-4408-8afd-0beb50f3bace None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:46.917645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c598-2eb5-4408-8afd-0beb50f3bace None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:46.918666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c598-2eb5-4408-8afd-0beb50f3bace None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:46.919206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c598-2eb5-4408-8afd-0beb50f3bace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:46.921025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c598-2eb5-4408-8afd-0beb50f3bace None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:46.935475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 213/409] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:46.950554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c598-2eb5-4408-8afd-0beb50f3bace None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:46.985239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:47.037541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce339c-70ea-4b4e-9ff4-545fbe6e50bc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:47.103090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fedb51-3be0-4d77-99c7-888f6acfbb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:47.104250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fedb51-3be0-4d77-99c7-888f6acfbb30 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:47.104625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c598-2eb5-4408-8afd-0beb50f3bace None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:47.105608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fedb51-3be0-4d77-99c7-888f6acfbb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:47.106150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fedb51-3be0-4d77-99c7-888f6acfbb30 None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:47.107998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fedb51-3be0-4d77-99c7-888f6acfbb30 None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:47.109844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fedb51-3be0-4d77-99c7-888f6acfbb30 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:47.113247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 197/410] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:46 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:47.121687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fedb51-3be0-4d77-99c7-888f6acfbb30 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:47.147736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a777-58d6-4a13-86df-9a925874a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:47.148396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a777-58d6-4a13-86df-9a925874a008 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:47.148668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a777-58d6-4a13-86df-9a925874a008 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:47.148937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a777-58d6-4a13-86df-9a925874a008 None admin] PATH_INFO: `/v3/groups/bcda3cb5fa144b4e9cd5cb1ccd4c602c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:47.150265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618a777-58d6-4a13-86df-9a925874a008 None admin] RBAC: Authorizing `identity:get_group(group_id=bcda3cb5fa144b4e9cd5cb1ccd4c602c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:47.151792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618a777-58d6-4a13-86df-9a925874a008 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:47.154889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 214/411] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:46 2022] GET /identity/v3/groups/bcda3cb5fa144b4e9cd5cb1ccd4c602c => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:47.164211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a777-58d6-4a13-86df-9a925874a008 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:47.235975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:47.281833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fedb51-3be0-4d77-99c7-888f6acfbb30 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:47.283941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a777-58d6-4a13-86df-9a925874a008 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:47.323333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368d3c2-5050-489d-8daf-0c07397c1b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:47.324419 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368d3c2-5050-489d-8daf-0c07397c1b92 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:47.324904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368d3c2-5050-489d-8daf-0c07397c1b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:47.325401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368d3c2-5050-489d-8daf-0c07397c1b92 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:47.326833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368d3c2-5050-489d-8daf-0c07397c1b92 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:47.328648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368d3c2-5050-489d-8daf-0c07397c1b92 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:47.331537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23499106-ec03-4265-94aa-e84e41b4a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:47.332084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 198/412] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:47 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:47.332206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23499106-ec03-4265-94aa-e84e41b4a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:47.337066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23499106-ec03-4265-94aa-e84e41b4a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:47.337066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23499106-ec03-4265-94aa-e84e41b4a6e2 None admin] PATH_INFO: `/v3/projects/fa445d84b8134f39a7735cb2fc7c685b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:47.337066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23499106-ec03-4265-94aa-e84e41b4a6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=fa445d84b8134f39a7735cb2fc7c685b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:47.337066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23499106-ec03-4265-94aa-e84e41b4a6e2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:47.337395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 215/413] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:47 2022] GET /identity/v3/projects/fa445d84b8134f39a7735cb2fc7c685b => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:47.338630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368d3c2-5050-489d-8daf-0c07397c1b92 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:47.342952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23499106-ec03-4265-94aa-e84e41b4a6e2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:47.353444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:47.468504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23499106-ec03-4265-94aa-e84e41b4a6e2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:47.473168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368d3c2-5050-489d-8daf-0c07397c1b92 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:47.500186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:47.513863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a1c99-a796-4534-9cb4-db272099af34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:47.514967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a1c99-a796-4534-9cb4-db272099af34 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:47.514967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a1c99-a796-4534-9cb4-db272099af34 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:47.515124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a1c99-a796-4534-9cb4-db272099af34 None admin] PATH_INFO: `/v3/projects/fa445d84b8134f39a7735cb2fc7c685b/groups/bcda3cb5fa144b4e9cd5cb1ccd4c602c/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:47.517915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a1c99-a796-4534-9cb4-db272099af34 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa445d84b8134f39a7735cb2fc7c685b, group_id=bcda3cb5fa144b4e9cd5cb1ccd4c602c, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:47.519335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a1c99-a796-4534-9cb4-db272099af34 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:47.522946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8e096-c710-4931-bd79-2a8bd71f0f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:47.524171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8e096-c710-4931-bd79-2a8bd71f0f66 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:47.524690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8e096-c710-4931-bd79-2a8bd71f0f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:47.525278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8e096-c710-4931-bd79-2a8bd71f0f66 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/groups/a49b056985924ec1b2148a47d53e044a/roles/ff90bae50e0644739e4bdec7431da2e0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:47.528112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8e096-c710-4931-bd79-2a8bd71f0f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ee0bb518b41478ab6403f510bfebe, group_id=a49b056985924ec1b2148a47d53e044a, role_id=ff90bae50e0644739e4bdec7431da2e0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:47.529907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8e096-c710-4931-bd79-2a8bd71f0f66 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:47.633575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 199/414] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Aug 31 10:58:47 2022] PUT /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe/groups/a49b056985924ec1b2148a47d53e044a/roles/ff90bae50e0644739e4bdec7431da2e0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:47.637739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245925b-e14e-4193-8df6-e9e1f02c1662 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:47.637739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245925b-e14e-4193-8df6-e9e1f02c1662 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:47.637739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245925b-e14e-4193-8df6-e9e1f02c1662 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:47.638049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 216/415] 10.222.0.13 () {58 vars in 1442 bytes} [Wed Aug 31 10:58:47 2022] PUT /identity/v3/projects/fa445d84b8134f39a7735cb2fc7c685b/groups/bcda3cb5fa144b4e9cd5cb1ccd4c602c/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:47.639276 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 200/416] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:47.646027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4c45b-e62a-4bd6-8559-3b1bf51883ba None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:47.646350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4c45b-e62a-4bd6-8559-3b1bf51883ba None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:47.646579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4c45b-e62a-4bd6-8559-3b1bf51883ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:47.680548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-dbf4c45b-e62a-4bd6-8559-3b1bf51883ba None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:47.681778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dbf4c45b-e62a-4bd6-8559-3b1bf51883ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:47.796402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 217/417] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:48.100600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245925b-e14e-4193-8df6-e9e1f02c1662 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:48.192336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:48.237589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5aaf-d911-4d38-9954-1113a14b229d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:48.238111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5aaf-d911-4d38-9954-1113a14b229d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:48.238111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5aaf-d911-4d38-9954-1113a14b229d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:48.239622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 218/418] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:58:48.244851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18f11-2c3b-42b1-8108-9f1809be6fe3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:48.245128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18f11-2c3b-42b1-8108-9f1809be6fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:48.245392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18f11-2c3b-42b1-8108-9f1809be6fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:48.246266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245925b-e14e-4193-8df6-e9e1f02c1662 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:48.267801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e2b18f11-2c3b-42b1-8108-9f1809be6fe3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:48.268351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e2b18f11-2c3b-42b1-8108-9f1809be6fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:48.324876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a39190-4dc4-4073-ae5b-fcb5b120e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:48.325513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a39190-4dc4-4073-ae5b-fcb5b120e18f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:48.325787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a39190-4dc4-4073-ae5b-fcb5b120e18f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:48.326053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a39190-4dc4-4073-ae5b-fcb5b120e18f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:48.356269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a39190-4dc4-4073-ae5b-fcb5b120e18f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-94a39190-4dc4-4073-ae5b-fcb5b120e18f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:48.368345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:48.369302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:48.370076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:48.371163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 201/419] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:48.378087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a39190-4dc4-4073-ae5b-fcb5b120e18f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:48.429036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 219/420] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:48.558710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a39190-4dc4-4073-ae5b-fcb5b120e18f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:48.593686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:48.604283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeac535-542f-4b90-973d-19e13f6f86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:48.611230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeac535-542f-4b90-973d-19e13f6f86f0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:48.611230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeac535-542f-4b90-973d-19e13f6f86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:48.611230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeac535-542f-4b90-973d-19e13f6f86f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:48.611230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeac535-542f-4b90-973d-19e13f6f86f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:48.611230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeac535-542f-4b90-973d-19e13f6f86f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:48.611230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeac535-542f-4b90-973d-19e13f6f86f0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:48.618490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 202/421] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:48.624658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18f11-2c3b-42b1-8108-9f1809be6fe3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:48.688214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:48.782053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18f11-2c3b-42b1-8108-9f1809be6fe3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:48.822986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeac535-542f-4b90-973d-19e13f6f86f0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:48.859524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db43823-6ffe-4a31-b9f3-b5a1c7bff1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:48.860157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db43823-6ffe-4a31-b9f3-b5a1c7bff1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:48.860959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db43823-6ffe-4a31-b9f3-b5a1c7bff1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:48.861221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db43823-6ffe-4a31-b9f3-b5a1c7bff1d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:49.020937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db43823-6ffe-4a31-b9f3-b5a1c7bff1d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:49.022374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db43823-6ffe-4a31-b9f3-b5a1c7bff1d7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:49.023412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeac535-542f-4b90-973d-19e13f6f86f0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:49.072978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c4bd4-8f0c-4444-85a1-a2ec091c83d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:49.073627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c4bd4-8f0c-4444-85a1-a2ec091c83d1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:49.073904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c4bd4-8f0c-4444-85a1-a2ec091c83d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:49.074179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c4bd4-8f0c-4444-85a1-a2ec091c83d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:49.096152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:49.108115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c4bd4-8f0c-4444-85a1-a2ec091c83d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-0c5c4bd4-8f0c-4444-85a1-a2ec091c83d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:49.114324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:49.116312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:49.117113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:49.123187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 203/422] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:49.131785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c4bd4-8f0c-4444-85a1-a2ec091c83d1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:49.180020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 220/423] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:49.189102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db43823-6ffe-4a31-b9f3-b5a1c7bff1d7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:49.261062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:49.346541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c4bd4-8f0c-4444-85a1-a2ec091c83d1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:49.407815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b7ec1-e2be-4086-9f5b-f3a08b19cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:49.408547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b7ec1-e2be-4086-9f5b-f3a08b19cc03 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:49.408903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b7ec1-e2be-4086-9f5b-f3a08b19cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:49.409190 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b7ec1-e2be-4086-9f5b-f3a08b19cc03 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:49.409874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b7ec1-e2be-4086-9f5b-f3a08b19cc03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:49.410176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b7ec1-e2be-4086-9f5b-f3a08b19cc03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:49.411588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b7ec1-e2be-4086-9f5b-f3a08b19cc03 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:49.440618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 204/424] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:49.441715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b7ec1-e2be-4086-9f5b-f3a08b19cc03 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:49.443161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db43823-6ffe-4a31-b9f3-b5a1c7bff1d7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:49.486362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1f3ad-83ea-4bbf-8a0c-0fb107fb0697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:49.487018 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1f3ad-83ea-4bbf-8a0c-0fb107fb0697 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:49.487361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1f3ad-83ea-4bbf-8a0c-0fb107fb0697 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:49.487639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1f3ad-83ea-4bbf-8a0c-0fb107fb0697 None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:49.488892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1f3ad-83ea-4bbf-8a0c-0fb107fb0697 None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:49.490349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1f3ad-83ea-4bbf-8a0c-0fb107fb0697 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:49.497012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 221/425] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:49 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:49.498360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa016a2-3a25-4f1a-b152-ed23ed492a61 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:49.498643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa016a2-3a25-4f1a-b152-ed23ed492a61 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:49.498918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa016a2-3a25-4f1a-b152-ed23ed492a61 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:49.500340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 222/426] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:49.501155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa016a2-3a25-4f1a-b152-ed23ed492a61 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:49.518830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:49.565741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b7ec1-e2be-4086-9f5b-f3a08b19cc03 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:49.579424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:49.602101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b3a98-79f2-4efd-8a3b-806dceb4fddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:49.602916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b3a98-79f2-4efd-8a3b-806dceb4fddc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:49.603269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b3a98-79f2-4efd-8a3b-806dceb4fddc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:49.603612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b3a98-79f2-4efd-8a3b-806dceb4fddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:49.627004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa016a2-3a25-4f1a-b152-ed23ed492a61 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:49.667999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82453019-015f-4d7e-b97c-5258e8682f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:49.668640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82453019-015f-4d7e-b97c-5258e8682f8f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:49.668913 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82453019-015f-4d7e-b97c-5258e8682f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:49.669179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82453019-015f-4d7e-b97c-5258e8682f8f None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:49.670624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82453019-015f-4d7e-b97c-5258e8682f8f None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:49.672101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82453019-015f-4d7e-b97c-5258e8682f8f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:49.680339 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 223/427] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:49 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:49.682295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a03979-e3e3-4ead-b48b-b2d9daac7fd4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:49.682572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a03979-e3e3-4ead-b48b-b2d9daac7fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:49.682962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a03979-e3e3-4ead-b48b-b2d9daac7fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:49.687150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b3a98-79f2-4efd-8a3b-806dceb4fddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:49.690475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b3a98-79f2-4efd-8a3b-806dceb4fddc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:49.704674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-74a03979-e3e3-4ead-b48b-b2d9daac7fd4 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:49.705863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-74a03979-e3e3-4ead-b48b-b2d9daac7fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:49.800136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 224/428] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:49.801240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a03979-e3e3-4ead-b48b-b2d9daac7fd4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:49.815674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 205/429] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:49.821892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b3a98-79f2-4efd-8a3b-806dceb4fddc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:49.824024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:49.837407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:49.934664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b3a98-79f2-4efd-8a3b-806dceb4fddc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:49.972411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a3db0-4b77-4204-8e1c-6ff1a1e9307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:49.973207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a3db0-4b77-4204-8e1c-6ff1a1e9307a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:49.973763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a3db0-4b77-4204-8e1c-6ff1a1e9307a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:49.974147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a3db0-4b77-4204-8e1c-6ff1a1e9307a None admin] PATH_INFO: `/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:49.975434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a3db0-4b77-4204-8e1c-6ff1a1e9307a None admin] RBAC: Authorizing `identity:get_project(project_id=3c595f0dd4dc4be48e21e5267bea2ccc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:49.977142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a3db0-4b77-4204-8e1c-6ff1a1e9307a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:49.979386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 206/430] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:49 2022] GET /identity/v3/projects/3c595f0dd4dc4be48e21e5267bea2ccc => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:49.985303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a3db0-4b77-4204-8e1c-6ff1a1e9307a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:49.986294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a03979-e3e3-4ead-b48b-b2d9daac7fd4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:50.024553 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061c93-b610-4191-8c63-79f593224f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:50.025160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061c93-b610-4191-8c63-79f593224f8c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.025432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061c93-b610-4191-8c63-79f593224f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.025703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061c93-b610-4191-8c63-79f593224f8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.026537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061c93-b610-4191-8c63-79f593224f8c None admin] RBAC: Adding query filter params (group.id=a49b056985924ec1b2148a47d53e044a, role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:50.026841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061c93-b610-4191-8c63-79f593224f8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:50.028417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061c93-b610-4191-8c63-79f593224f8c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:50.035436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 225/431] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:49 2022] GET /identity/v3/role_assignments?group.id=a49b056985924ec1b2148a47d53e044a&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:50.081792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:50.104260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a3db0-4b77-4204-8e1c-6ff1a1e9307a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:50.144325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f93801-db30-4f8d-8b57-4baa6d1af034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:50.145314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f93801-db30-4f8d-8b57-4baa6d1af034 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.145563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f93801-db30-4f8d-8b57-4baa6d1af034 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.145780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f93801-db30-4f8d-8b57-4baa6d1af034 None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.146968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f93801-db30-4f8d-8b57-4baa6d1af034 None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:50.148581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f93801-db30-4f8d-8b57-4baa6d1af034 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:50.150542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 207/432] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:49 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:50.156448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061c93-b610-4191-8c63-79f593224f8c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:50.279604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:50.284264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f93801-db30-4f8d-8b57-4baa6d1af034 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:50.328656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061c93-b610-4191-8c63-79f593224f8c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:50.372278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09e35-f5fc-4081-81b0-5a3211a7bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:50.372650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09e35-f5fc-4081-81b0-5a3211a7bede None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.372844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09e35-f5fc-4081-81b0-5a3211a7bede None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.373549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09e35-f5fc-4081-81b0-5a3211a7bede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.373812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09e35-f5fc-4081-81b0-5a3211a7bede None admin] RBAC: Adding query filter params (group.id=a49b056985924ec1b2148a47d53e044a, role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:50.374114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09e35-f5fc-4081-81b0-5a3211a7bede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:50.375574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09e35-f5fc-4081-81b0-5a3211a7bede None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:50.383545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 226/433] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:50 2022] GET /identity/v3/role_assignments?group.id=a49b056985924ec1b2148a47d53e044a&scope.project.id=3c595f0dd4dc4be48e21e5267bea2ccc&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:50.384944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a57a79-ee84-430f-9d19-51189ffdc5ba None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.385225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a57a79-ee84-430f-9d19-51189ffdc5ba None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.385496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a57a79-ee84-430f-9d19-51189ffdc5ba None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.387038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 227/434] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:50.393054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3acad-4181-4d00-8445-dbff022c2fc4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.393351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3acad-4181-4d00-8445-dbff022c2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.393596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3acad-4181-4d00-8445-dbff022c2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.414131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a3f3acad-4181-4d00-8445-dbff022c2fc4 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:50.415514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a3f3acad-4181-4d00-8445-dbff022c2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:50.451632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f93801-db30-4f8d-8b57-4baa6d1af034 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:50.504640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b5879-0461-4446-8d47-dc9385669191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:50.505865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b5879-0461-4446-8d47-dc9385669191 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.506483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b5879-0461-4446-8d47-dc9385669191 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.507179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b5879-0461-4446-8d47-dc9385669191 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.512965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 228/435] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:50.514291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7ae54-5906-43d5-ad23-db8f82760248 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.514580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7ae54-5906-43d5-ad23-db8f82760248 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.514854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7ae54-5906-43d5-ad23-db8f82760248 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.519786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 229/436] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:50.522783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a11299-67cb-4441-9e1a-38ad1a818a49 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.523324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a11299-67cb-4441-9e1a-38ad1a818a49 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.523852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a11299-67cb-4441-9e1a-38ad1a818a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.527005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b5879-0461-4446-8d47-dc9385669191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-b81b5879-0461-4446-8d47-dc9385669191 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:50.534196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:50.535167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:50.536701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 208/437] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:50.541486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b5879-0461-4446-8d47-dc9385669191 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:50.549874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d3a11299-67cb-4441-9e1a-38ad1a818a49 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:50.551511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d3a11299-67cb-4441-9e1a-38ad1a818a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:50.555954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:50.636763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:50.647636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 230/438] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:50.689651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b5879-0461-4446-8d47-dc9385669191 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:50.729176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb496a0b-2967-4f13-86e5-985b64436c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:50.729792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb496a0b-2967-4f13-86e5-985b64436c7a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.730071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb496a0b-2967-4f13-86e5-985b64436c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.730350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb496a0b-2967-4f13-86e5-985b64436c7a None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.731030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb496a0b-2967-4f13-86e5-985b64436c7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:50.731385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb496a0b-2967-4f13-86e5-985b64436c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:50.732749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb496a0b-2967-4f13-86e5-985b64436c7a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:50.748250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 209/439] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:58:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:50.755492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a11299-67cb-4441-9e1a-38ad1a818a49 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:50.820855 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb496a0b-2967-4f13-86e5-985b64436c7a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:50.875295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a11299-67cb-4441-9e1a-38ad1a818a49 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:50.907800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:50.926038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5c64-5221-4b15-8d7a-af1edd452b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:50.927463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5c64-5221-4b15-8d7a-af1edd452b25 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:50.927993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5c64-5221-4b15-8d7a-af1edd452b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:50.928731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5c64-5221-4b15-8d7a-af1edd452b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:50.955846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb496a0b-2967-4f13-86e5-985b64436c7a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:51.000391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d69ac6-b612-4149-a876-d1f50efb6cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:51.001874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d69ac6-b612-4149-a876-d1f50efb6cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:51.002304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d69ac6-b612-4149-a876-d1f50efb6cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:51.002730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d69ac6-b612-4149-a876-d1f50efb6cb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:51.009200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:51.013918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d69ac6-b612-4149-a876-d1f50efb6cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:51.016681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5c64-5221-4b15-8d7a-af1edd452b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:51.018148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5c64-5221-4b15-8d7a-af1edd452b25 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-c6d69ac6-b612-4149-a876-d1f50efb6cb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:51.019734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:51.024816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 210/440] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:51.025780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d69ac6-b612-4149-a876-d1f50efb6cb0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:51.122892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 231/441] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:51.123886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5c64-5221-4b15-8d7a-af1edd452b25 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:51.127079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d69ac6-b612-4149-a876-d1f50efb6cb0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:51.157579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:51.163830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc3247-3f8d-412b-8edc-14b3c71e3358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:51.164501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc3247-3f8d-412b-8edc-14b3c71e3358 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:51.164843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc3247-3f8d-412b-8edc-14b3c71e3358 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:51.165189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc3247-3f8d-412b-8edc-14b3c71e3358 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:51.177452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc3247-3f8d-412b-8edc-14b3c71e3358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-03cc3247-3f8d-412b-8edc-14b3c71e3358 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:51.182724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:51.183637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:51.184896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 211/442] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:51.185691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc3247-3f8d-412b-8edc-14b3c71e3358 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:51.225068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:51.230924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5c64-5221-4b15-8d7a-af1edd452b25 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:51.266547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee23f58-fd9d-4ee3-823c-6a0bce1066e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:51.267193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee23f58-fd9d-4ee3-823c-6a0bce1066e7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:51.267465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee23f58-fd9d-4ee3-823c-6a0bce1066e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:51.267732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee23f58-fd9d-4ee3-823c-6a0bce1066e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:51.268430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee23f58-fd9d-4ee3-823c-6a0bce1066e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:51.268727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee23f58-fd9d-4ee3-823c-6a0bce1066e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:51.270244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee23f58-fd9d-4ee3-823c-6a0bce1066e7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:51.280411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 232/443] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:51.282837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee23f58-fd9d-4ee3-823c-6a0bce1066e7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:51.326258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc3247-3f8d-412b-8edc-14b3c71e3358 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:51.365831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a9a74-b0a8-47df-951a-f54b6db20247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:51.366455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a9a74-b0a8-47df-951a-f54b6db20247 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:51.366728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a9a74-b0a8-47df-951a-f54b6db20247 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:51.366994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a9a74-b0a8-47df-951a-f54b6db20247 None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:51.368138 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a9a74-b0a8-47df-951a-f54b6db20247 None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:51.369678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a9a74-b0a8-47df-951a-f54b6db20247 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:51.371295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 212/444] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:51 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:51.372079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a9a74-b0a8-47df-951a-f54b6db20247 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:51.391878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee23f58-fd9d-4ee3-823c-6a0bce1066e7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:51.426405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f0291-3e67-4094-946c-6ac1deb36d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:51.426921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f0291-3e67-4094-946c-6ac1deb36d64 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:51.427204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f0291-3e67-4094-946c-6ac1deb36d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:51.427472 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f0291-3e67-4094-946c-6ac1deb36d64 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:51.428411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f0291-3e67-4094-946c-6ac1deb36d64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:51.428710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f0291-3e67-4094-946c-6ac1deb36d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:51.430081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f0291-3e67-4094-946c-6ac1deb36d64 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:51.435553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:51.438939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 233/445] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:51.439805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f0291-3e67-4094-946c-6ac1deb36d64 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:51.464307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:51.481791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a9a74-b0a8-47df-951a-f54b6db20247 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:51.518001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e9608-c0b0-405d-8c35-13af08caef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:51.518614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e9608-c0b0-405d-8c35-13af08caef03 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:51.518905 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e9608-c0b0-405d-8c35-13af08caef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:51.519176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e9608-c0b0-405d-8c35-13af08caef03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:51.558170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f0291-3e67-4094-946c-6ac1deb36d64 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:51.593145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e9608-c0b0-405d-8c35-13af08caef03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:51.595389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e9608-c0b0-405d-8c35-13af08caef03 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:51.600010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa591d49-b67e-49ff-8a91-af56156b5f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:51.600640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa591d49-b67e-49ff-8a91-af56156b5f5d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:51.600921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa591d49-b67e-49ff-8a91-af56156b5f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:51.601197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa591d49-b67e-49ff-8a91-af56156b5f5d None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:51.602341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa591d49-b67e-49ff-8a91-af56156b5f5d None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:51.603831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa591d49-b67e-49ff-8a91-af56156b5f5d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:51.605580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 234/446] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:51 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:51.606353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa591d49-b67e-49ff-8a91-af56156b5f5d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:51.669895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:51.717703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:51.725915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 213/447] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:51.731061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e9608-c0b0-405d-8c35-13af08caef03 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:51.731602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa591d49-b67e-49ff-8a91-af56156b5f5d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:51.774996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028174-d56d-4784-a939-85fd4a2e785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:51.775728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028174-d56d-4784-a939-85fd4a2e785d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:51.776033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028174-d56d-4784-a939-85fd4a2e785d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:51.776304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028174-d56d-4784-a939-85fd4a2e785d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:51.848730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e9608-c0b0-405d-8c35-13af08caef03 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:51.851256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39028174-d56d-4784-a939-85fd4a2e785d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:51.852783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39028174-d56d-4784-a939-85fd4a2e785d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:51.883455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6512c16-6d7e-47d0-88f9-999f21bf1538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:51.884173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6512c16-6d7e-47d0-88f9-999f21bf1538 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:51.884447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6512c16-6d7e-47d0-88f9-999f21bf1538 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:51.884711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6512c16-6d7e-47d0-88f9-999f21bf1538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:51.885441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6512c16-6d7e-47d0-88f9-999f21bf1538 None admin] RBAC: Adding query filter params (group.id=a49b056985924ec1b2148a47d53e044a, role.id=eae8aac7335344e48b3a6e3b9ffcba0a, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:51.885744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6512c16-6d7e-47d0-88f9-999f21bf1538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:51.887189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6512c16-6d7e-47d0-88f9-999f21bf1538 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:51.893815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 214/448] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:51 2022] GET /identity/v3/role_assignments?group.id=a49b056985924ec1b2148a47d53e044a&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=eae8aac7335344e48b3a6e3b9ffcba0a => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:51.894750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6512c16-6d7e-47d0-88f9-999f21bf1538 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:51.932092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:51.975401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:52.000027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 235/449] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:52.002116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028174-d56d-4784-a939-85fd4a2e785d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.028661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6512c16-6d7e-47d0-88f9-999f21bf1538 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.078484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cbdc1-b7e8-4796-be0a-a8b1a568242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.079702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cbdc1-b7e8-4796-be0a-a8b1a568242b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.080052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cbdc1-b7e8-4796-be0a-a8b1a568242b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.080402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cbdc1-b7e8-4796-be0a-a8b1a568242b None admin] PATH_INFO: `/v3/projects/aa8ee0bb518b41478ab6403f510bfebe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.081484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cbdc1-b7e8-4796-be0a-a8b1a568242b None admin] RBAC: Authorizing `identity:get_project(project_id=aa8ee0bb518b41478ab6403f510bfebe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.083117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cbdc1-b7e8-4796-be0a-a8b1a568242b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.085109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 215/450] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:51 2022] GET /identity/v3/projects/aa8ee0bb518b41478ab6403f510bfebe => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:52.091604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cbdc1-b7e8-4796-be0a-a8b1a568242b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.123201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028174-d56d-4784-a939-85fd4a2e785d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.168952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d33c9-3183-44c4-8efb-83d20fc392a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.169588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d33c9-3183-44c4-8efb-83d20fc392a6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.169861 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d33c9-3183-44c4-8efb-83d20fc392a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.170136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d33c9-3183-44c4-8efb-83d20fc392a6 None admin] PATH_INFO: `/v3/projects/fa445d84b8134f39a7735cb2fc7c685b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.171313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d33c9-3183-44c4-8efb-83d20fc392a6 None admin] RBAC: Authorizing `identity:get_project(project_id=fa445d84b8134f39a7735cb2fc7c685b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.172832 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d33c9-3183-44c4-8efb-83d20fc392a6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.174817 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 236/451] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 10:58:52 2022] GET /identity/v3/projects/fa445d84b8134f39a7735cb2fc7c685b => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:52.180765 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d33c9-3183-44c4-8efb-83d20fc392a6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.215910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:52.233333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cbdc1-b7e8-4796-be0a-a8b1a568242b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.258412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:52.282612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26277f-9a02-4cdf-96c6-9fab5483cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.282716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26277f-9a02-4cdf-96c6-9fab5483cd44 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.282981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26277f-9a02-4cdf-96c6-9fab5483cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.283255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26277f-9a02-4cdf-96c6-9fab5483cd44 None admin] PATH_INFO: `/v3/groups/a49b056985924ec1b2148a47d53e044a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.284532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26277f-9a02-4cdf-96c6-9fab5483cd44 None admin] RBAC: Authorizing `identity:get_group(group_id=a49b056985924ec1b2148a47d53e044a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.286065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26277f-9a02-4cdf-96c6-9fab5483cd44 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.287700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 216/452] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:52 2022] GET /identity/v3/groups/a49b056985924ec1b2148a47d53e044a => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:52.296399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26277f-9a02-4cdf-96c6-9fab5483cd44 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.318327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d33c9-3183-44c4-8efb-83d20fc392a6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.355868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c5ada-0976-4a6e-b7f0-81e25e4b6690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.356512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c5ada-0976-4a6e-b7f0-81e25e4b6690 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.356790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c5ada-0976-4a6e-b7f0-81e25e4b6690 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.357065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c5ada-0976-4a6e-b7f0-81e25e4b6690 None admin] PATH_INFO: `/v3/groups/bcda3cb5fa144b4e9cd5cb1ccd4c602c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.358217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c5ada-0976-4a6e-b7f0-81e25e4b6690 None admin] RBAC: Authorizing `identity:get_group(group_id=bcda3cb5fa144b4e9cd5cb1ccd4c602c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.359675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c5ada-0976-4a6e-b7f0-81e25e4b6690 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.362240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 237/453] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Aug 31 10:58:52 2022] GET /identity/v3/groups/bcda3cb5fa144b4e9cd5cb1ccd4c602c => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:52.368383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c5ada-0976-4a6e-b7f0-81e25e4b6690 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.408302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26277f-9a02-4cdf-96c6-9fab5483cd44 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.451265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51953f16-ecc2-4a34-b82b-f38877ce1d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.452192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51953f16-ecc2-4a34-b82b-f38877ce1d70 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.452471 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51953f16-ecc2-4a34-b82b-f38877ce1d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.452740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51953f16-ecc2-4a34-b82b-f38877ce1d70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.453634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51953f16-ecc2-4a34-b82b-f38877ce1d70 None admin] RBAC: Adding query filter params (group.id=a49b056985924ec1b2148a47d53e044a, role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=aa8ee0bb518b41478ab6403f510bfebe) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:52.454058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51953f16-ecc2-4a34-b82b-f38877ce1d70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.456099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51953f16-ecc2-4a34-b82b-f38877ce1d70 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.462579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 217/454] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:52 2022] GET /identity/v3/role_assignments?group.id=a49b056985924ec1b2148a47d53e044a&scope.project.id=aa8ee0bb518b41478ab6403f510bfebe&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:52.477681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c5ada-0976-4a6e-b7f0-81e25e4b6690 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.518242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:52.529869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65a44b-9b92-49dd-940c-81dc6de873c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.530493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a44b-9b92-49dd-940c-81dc6de873c0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.530765 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a44b-9b92-49dd-940c-81dc6de873c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.531030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65a44b-9b92-49dd-940c-81dc6de873c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.540128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65a44b-9b92-49dd-940c-81dc6de873c0 None admin] RBAC: Adding query filter params (group.id=bcda3cb5fa144b4e9cd5cb1ccd4c602c, role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=fa445d84b8134f39a7735cb2fc7c685b) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:52.540128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65a44b-9b92-49dd-940c-81dc6de873c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.540128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65a44b-9b92-49dd-940c-81dc6de873c0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.540940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 238/455] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Aug 31 10:58:52 2022] GET /identity/v3/role_assignments?group.id=bcda3cb5fa144b4e9cd5cb1ccd4c602c&scope.project.id=fa445d84b8134f39a7735cb2fc7c685b&role.id=55aed406476a485f99f9815f9f27cb3b => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:55.098986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966acf-2f1b-43dc-be08-a6945706bea9 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.099510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966acf-2f1b-43dc-be08-a6945706bea9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.099510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966acf-2f1b-43dc-be08-a6945706bea9 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.101148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 218/456] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:55.106779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9721cb-7718-4fa6-b8c0-5a0ea4f3f7fc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.107780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9721cb-7718-4fa6-b8c0-5a0ea4f3f7fc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.108265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9721cb-7718-4fa6-b8c0-5a0ea4f3f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.136179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7a9721cb-7718-4fa6-b8c0-5a0ea4f3f7fc None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:55.137738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7a9721cb-7718-4fa6-b8c0-5a0ea4f3f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.241118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 239/457] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:55.278644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbfb6f-5be2-4128-9ec3-1aa13ce3bd48 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.279250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbfb6f-5be2-4128-9ec3-1aa13ce3bd48 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.279723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbfb6f-5be2-4128-9ec3-1aa13ce3bd48 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.283765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 219/458] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:55.287190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502d609-d68f-482f-a6c3-8b0adaec431b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.287476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502d609-d68f-482f-a6c3-8b0adaec431b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.287965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502d609-d68f-482f-a6c3-8b0adaec431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.312704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1502d609-d68f-482f-a6c3-8b0adaec431b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:55.314833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1502d609-d68f-482f-a6c3-8b0adaec431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.401481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 240/459] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:55.582853 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbfb6f-5be2-4128-9ec3-1aa13ce3bd48 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.614667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:55.712011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbfb6f-5be2-4128-9ec3-1aa13ce3bd48 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.758281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2466c19-892a-4025-b577-b9829a595c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.758925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2466c19-892a-4025-b577-b9829a595c9d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.759199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2466c19-892a-4025-b577-b9829a595c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.759464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2466c19-892a-4025-b577-b9829a595c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.768832 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43f20-05f4-481c-8e26-6f0f5a127ee2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.769110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43f20-05f4-481c-8e26-6f0f5a127ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.769572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43f20-05f4-481c-8e26-6f0f5a127ee2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.771574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 241/460] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:55.775609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2466c19-892a-4025-b577-b9829a595c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.776079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2466c19-892a-4025-b577-b9829a595c9d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.777030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a76b5-c60c-4b3b-aa5d-06cc6dbd7d8e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.777531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a76b5-c60c-4b3b-aa5d-06cc6dbd7d8e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.778031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a76b5-c60c-4b3b-aa5d-06cc6dbd7d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-b2466c19-892a-4025-b577-b9829a595c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:58:55.800201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:55.801179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:58:55.802029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:58:55.802029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:55.802029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:55.809446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 220/461] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:55.810683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3a6a76b5-c60c-4b3b-aa5d-06cc6dbd7d8e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:55.811727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2466c19-892a-4025-b577-b9829a595c9d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.816638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3a6a76b5-c60c-4b3b-aa5d-06cc6dbd7d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.896628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:55.929632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 242/462] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:55.930687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a76b5-c60c-4b3b-aa5d-06cc6dbd7d8e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.934253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:55.961225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2466c19-892a-4025-b577-b9829a595c9d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.002217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77288d-314e-4dc1-a872-1186a1d049fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.003350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77288d-314e-4dc1-a872-1186a1d049fd None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.003887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77288d-314e-4dc1-a872-1186a1d049fd None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.004374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77288d-314e-4dc1-a872-1186a1d049fd None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.005381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77288d-314e-4dc1-a872-1186a1d049fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:56.005901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77288d-314e-4dc1-a872-1186a1d049fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.007563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77288d-314e-4dc1-a872-1186a1d049fd None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.027831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 221/463] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:56.029445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647ddf4-4cd1-463f-b050-f27c09a164fe None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.029926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647ddf4-4cd1-463f-b050-f27c09a164fe None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.030391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647ddf4-4cd1-463f-b050-f27c09a164fe None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.034889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 222/464] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:56.034889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647ddf4-4cd1-463f-b050-f27c09a164fe None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:56.062561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a76b5-c60c-4b3b-aa5d-06cc6dbd7d8e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.115986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c43961-4cd4-4f41-a1d2-d878be7d2256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.118249 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c43961-4cd4-4f41-a1d2-d878be7d2256 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.118689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c43961-4cd4-4f41-a1d2-d878be7d2256 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.119107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c43961-4cd4-4f41-a1d2-d878be7d2256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.133016 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c43961-4cd4-4f41-a1d2-d878be7d2256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.135380 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c43961-4cd4-4f41-a1d2-d878be7d2256 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.152563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647ddf4-4cd1-463f-b050-f27c09a164fe None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d5c43961-4cd4-4f41-a1d2-d878be7d2256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:58:56.158790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:56.159732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:58:56.160655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:58:56.160655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:56.160655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:56.163949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 243/465] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:56.166449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd986c90-802c-4953-8211-477483b9e9ea None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.167509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd986c90-802c-4953-8211-477483b9e9ea None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.168914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd986c90-802c-4953-8211-477483b9e9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.190314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-dd986c90-802c-4953-8211-477483b9e9ea None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:56.191508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dd986c90-802c-4953-8211-477483b9e9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:56.200387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe904cf4-ce58-441f-9ec6-eaa206ddf2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.201350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe904cf4-ce58-441f-9ec6-eaa206ddf2e7 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.202222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe904cf4-ce58-441f-9ec6-eaa206ddf2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.202727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe904cf4-ce58-441f-9ec6-eaa206ddf2e7 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.204486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe904cf4-ce58-441f-9ec6-eaa206ddf2e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.206433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe904cf4-ce58-441f-9ec6-eaa206ddf2e7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.217357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:56.222353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:56.265203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 244/466] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:56.265982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd986c90-802c-4953-8211-477483b9e9ea None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:56.367844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 223/467] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:58:56 2022] POST /identity/v3/users => generated 246 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:56.367844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe904cf4-ce58-441f-9ec6-eaa206ddf2e7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:56.441608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd986c90-802c-4953-8211-477483b9e9ea None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.551315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2aff1-8c53-4ae1-8d3d-e3abc75c1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.552000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2aff1-8c53-4ae1-8d3d-e3abc75c1f99 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.552280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2aff1-8c53-4ae1-8d3d-e3abc75c1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.552548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2aff1-8c53-4ae1-8d3d-e3abc75c1f99 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.553464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2aff1-8c53-4ae1-8d3d-e3abc75c1f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:56.553767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2aff1-8c53-4ae1-8d3d-e3abc75c1f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.555165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2aff1-8c53-4ae1-8d3d-e3abc75c1f99 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.590418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 245/468] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:56.590418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2aff1-8c53-4ae1-8d3d-e3abc75c1f99 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:56.620972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:56.632886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe904cf4-ce58-441f-9ec6-eaa206ddf2e7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.679995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c09d-3830-4add-b896-30c41b175b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.680836 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c09d-3830-4add-b896-30c41b175b2c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.681485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c09d-3830-4add-b896-30c41b175b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.681865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c09d-3830-4add-b896-30c41b175b2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.697838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c09d-3830-4add-b896-30c41b175b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.700039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c09d-3830-4add-b896-30c41b175b2c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.733662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2aff1-8c53-4ae1-8d3d-e3abc75c1f99 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-7b73c09d-3830-4add-b896-30c41b175b2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:58:56.739092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:56.740071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:58:56.740933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:58:56.740933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:56.740933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:56.743578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 224/469] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:56.744693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c09d-3830-4add-b896-30c41b175b2c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:56.788021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b069-e67f-4633-a2d1-30f674e39012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.788657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b069-e67f-4633-a2d1-30f674e39012 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.788934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b069-e67f-4633-a2d1-30f674e39012 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.789201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194b069-e67f-4633-a2d1-30f674e39012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.800808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194b069-e67f-4633-a2d1-30f674e39012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.802323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194b069-e67f-4633-a2d1-30f674e39012 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.811708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8194b069-e67f-4633-a2d1-30f674e39012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:58:56.817438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:56.818346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:58:56.819214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:58:56.819214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:56.819214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:56.823383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 246/470] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:56.824247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b069-e67f-4633-a2d1-30f674e39012 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:56.899211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c09d-3830-4add-b896-30c41b175b2c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.910617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:56.935324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dbfe8-811d-46c3-92a8-ca8bfd6b438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.935969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dbfe8-811d-46c3-92a8-ca8bfd6b438f None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.936255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dbfe8-811d-46c3-92a8-ca8bfd6b438f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.936521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dbfe8-811d-46c3-92a8-ca8bfd6b438f None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.937168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dbfe8-811d-46c3-92a8-ca8bfd6b438f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.939309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dbfe8-811d-46c3-92a8-ca8bfd6b438f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.944431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194b069-e67f-4633-a2d1-30f674e39012 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.978154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60096-d9e8-4cfe-865c-7b808b23935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.978759 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60096-d9e8-4cfe-865c-7b808b23935f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.979032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60096-d9e8-4cfe-865c-7b808b23935f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.979300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60096-d9e8-4cfe-865c-7b808b23935f None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.979957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60096-d9e8-4cfe-865c-7b808b23935f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:56.980255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60096-d9e8-4cfe-865c-7b808b23935f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.981809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60096-d9e8-4cfe-865c-7b808b23935f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.994754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 247/471] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:56.996135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219285-7960-4be4-9113-71d58785e029 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.996428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219285-7960-4be4-9113-71d58785e029 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.996700 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219285-7960-4be4-9113-71d58785e029 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.998035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 248/472] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:56.998640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219285-7960-4be4-9113-71d58785e029 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:57.059554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 225/473] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:58:56 2022] POST /identity/v3/users => generated 248 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:57.060706 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dbfe8-811d-46c3-92a8-ca8bfd6b438f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:57.134945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219285-7960-4be4-9113-71d58785e029 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:57.171801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:57.177667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b746a2e-a8e8-46d1-9b9e-4a8b9a989543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:57.178755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b746a2e-a8e8-46d1-9b9e-4a8b9a989543 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:57.179031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b746a2e-a8e8-46d1-9b9e-4a8b9a989543 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:57.179306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b746a2e-a8e8-46d1-9b9e-4a8b9a989543 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:57.180048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b746a2e-a8e8-46d1-9b9e-4a8b9a989543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:57.180349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b746a2e-a8e8-46d1-9b9e-4a8b9a989543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:57.181959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b746a2e-a8e8-46d1-9b9e-4a8b9a989543 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:57.196596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 249/474] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:57.198013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e67dd-40be-4a54-8312-1d32110fd865 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:57.198302 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e67dd-40be-4a54-8312-1d32110fd865 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:57.198576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e67dd-40be-4a54-8312-1d32110fd865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:57.211293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:57.215178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dbfe8-811d-46c3-92a8-ca8bfd6b438f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:57.222307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fc0e67dd-40be-4a54-8312-1d32110fd865 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:57.223901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fc0e67dd-40be-4a54-8312-1d32110fd865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:57.267634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8edba-6c89-47f8-b5d8-127aa239c88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:57.268429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8edba-6c89-47f8-b5d8-127aa239c88b None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:57.268601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8edba-6c89-47f8-b5d8-127aa239c88b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:57.268828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8edba-6c89-47f8-b5d8-127aa239c88b None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:57.269784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8edba-6c89-47f8-b5d8-127aa239c88b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:57.270903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8edba-6c89-47f8-b5d8-127aa239c88b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:57.317311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 250/475] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:57.318470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e67dd-40be-4a54-8312-1d32110fd865 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:57.441194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 226/476] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:58:57 2022] POST /identity/v3/users => generated 249 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:57.444847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e67dd-40be-4a54-8312-1d32110fd865 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:57.473044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:57.485864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112689-d215-4991-a6a5-cf169f61d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:57.486454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112689-d215-4991-a6a5-cf169f61d4a9 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:57.486770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112689-d215-4991-a6a5-cf169f61d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:57.487039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112689-d215-4991-a6a5-cf169f61d4a9 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:57.487694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89112689-d215-4991-a6a5-cf169f61d4a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:57.489253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89112689-d215-4991-a6a5-cf169f61d4a9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:57.627225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8edba-6c89-47f8-b5d8-127aa239c88b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:57.695538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 251/477] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:58:57 2022] POST /identity/v3/users => generated 248 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:57.749461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8edba-6c89-47f8-b5d8-127aa239c88b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:57.795045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:57.795680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:57.795994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:57.796270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:57.796954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:57.798992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:57.848956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.sql.core [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:58:57.848956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 10:58:57.848956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [parameters: {'id': 'b601e779fa45498fa201611ff45c6c8d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 10:58:57.848956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81884) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 31 10:58:57.868565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:58:57.869641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application yield resource Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise self.value Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application session.commit() Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:58:57.870579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:58:57.871430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:58:57.873807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:58:57.876398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [parameters: {'id': 'b601e779fa45498fa201611ff45c6c8d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:57.878648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 10:58:57.879650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:58:57.880686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 227/478] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Aug 31 10:58:57 2022] POST /identity/v3/roles => generated 144 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:58:57.880756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112689-d215-4991-a6a5-cf169f61d4a9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:57.994703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112689-d215-4991-a6a5-cf169f61d4a9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:58.031442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e66bc9-0398-4ab3-9765-483958ae0bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:58.033104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e66bc9-0398-4ab3-9765-483958ae0bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:58.033518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e66bc9-0398-4ab3-9765-483958ae0bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:58.033950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e66bc9-0398-4ab3-9765-483958ae0bf8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:58.045387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e66bc9-0398-4ab3-9765-483958ae0bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-94e66bc9-0398-4ab3-9765-483958ae0bf8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:58.051414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:58.052468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:58:58.053696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:58.056070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 252/479] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:58:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:58.061653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:58.085748 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:58.185888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd5cad-a29f-499d-a7b6-4a40408282f8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:58.228564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0678d-66d5-426f-a080-87caa32d10ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:58.229836 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0678d-66d5-426f-a080-87caa32d10ba None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:58.230289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0678d-66d5-426f-a080-87caa32d10ba None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:58.230701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0678d-66d5-426f-a080-87caa32d10ba None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:58.231515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0678d-66d5-426f-a080-87caa32d10ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:58.231983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0678d-66d5-426f-a080-87caa32d10ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:58.233546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0678d-66d5-426f-a080-87caa32d10ba None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:58.243191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 228/480] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:58:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:58.699088 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165659e-b10c-443e-ad5b-1aee0a3b92d4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:58.699641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165659e-b10c-443e-ad5b-1aee0a3b92d4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:58.699641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165659e-b10c-443e-ad5b-1aee0a3b92d4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:58.701552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 253/481] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:58.707127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1366d-c204-4802-9ba8-8fb38b41d2cf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:58.707663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1366d-c204-4802-9ba8-8fb38b41d2cf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:58.708166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1366d-c204-4802-9ba8-8fb38b41d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:58.728423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5da1366d-c204-4802-9ba8-8fb38b41d2cf None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:58.729939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5da1366d-c204-4802-9ba8-8fb38b41d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:58.805056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 229/482] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:59.099312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165659e-b10c-443e-ad5b-1aee0a3b92d4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.152509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:59.237257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165659e-b10c-443e-ad5b-1aee0a3b92d4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.292474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b597b5-b60a-4b38-ad40-2eee1c73e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.293492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b597b5-b60a-4b38-ad40-2eee1c73e6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.293965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b597b5-b60a-4b38-ad40-2eee1c73e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.294427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b597b5-b60a-4b38-ad40-2eee1c73e6d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.312206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b597b5-b60a-4b38-ad40-2eee1c73e6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-76b597b5-b60a-4b38-ad40-2eee1c73e6d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:58:59.318640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:59.319536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:58:59.320391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:59.322837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 254/483] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:58:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:59.328311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1366d-c204-4802-9ba8-8fb38b41d2cf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.342116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:59.343054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def55ef0-f5a9-4ac6-9c1f-a73ff23ff754 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.343253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def55ef0-f5a9-4ac6-9c1f-a73ff23ff754 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.343533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def55ef0-f5a9-4ac6-9c1f-a73ff23ff754 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.345223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 255/484] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:59.356460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa1094-6f7a-4427-bb04-01c8e3267598 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.356460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa1094-6f7a-4427-bb04-01c8e3267598 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.356460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa1094-6f7a-4427-bb04-01c8e3267598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.374539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ebfa1094-6f7a-4427-bb04-01c8e3267598 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:59.376974 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ebfa1094-6f7a-4427-bb04-01c8e3267598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:59.458515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1366d-c204-4802-9ba8-8fb38b41d2cf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.458915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 256/485] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:59.496299 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565662bf-0449-477e-862d-4dd1635fce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.496925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565662bf-0449-477e-862d-4dd1635fce1f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.497204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565662bf-0449-477e-862d-4dd1635fce1f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.497473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565662bf-0449-477e-862d-4dd1635fce1f None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.498151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565662bf-0449-477e-862d-4dd1635fce1f None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:59.498451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565662bf-0449-477e-862d-4dd1635fce1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.500003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565662bf-0449-477e-862d-4dd1635fce1f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.510379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 230/486] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:58:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:59.515621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa1094-6f7a-4427-bb04-01c8e3267598 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.558315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:59.664069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa1094-6f7a-4427-bb04-01c8e3267598 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.711132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e1559-8373-4130-b0cb-3dae87638124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.711816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1559-8373-4130-b0cb-3dae87638124 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.712070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1559-8373-4130-b0cb-3dae87638124 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.712341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e1559-8373-4130-b0cb-3dae87638124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.729146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e1559-8373-4130-b0cb-3dae87638124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.730717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e1559-8373-4130-b0cb-3dae87638124 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-875e1559-8373-4130-b0cb-3dae87638124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:58:59.756599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:58:59.757574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:58:59.758844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:58:59.758844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:58:59.758844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:58:59.758844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 257/487] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:58:59.764497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565662bf-0449-477e-862d-4dd1635fce1f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.869204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:59.887288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e1559-8373-4130-b0cb-3dae87638124 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.905461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565662bf-0449-477e-862d-4dd1635fce1f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.944650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa3b2-8712-4760-8260-ab001b7ce1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.945184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa3b2-8712-4760-8260-ab001b7ce1cc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.945439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa3b2-8712-4760-8260-ab001b7ce1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.945688 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa3b2-8712-4760-8260-ab001b7ce1cc None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.946344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fa3b2-8712-4760-8260-ab001b7ce1cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:59.946644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fa3b2-8712-4760-8260-ab001b7ce1cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.951795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fa3b2-8712-4760-8260-ab001b7ce1cc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.962461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 231/488] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:59.967488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa3b2-8712-4760-8260-ab001b7ce1cc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.068205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:00.084707 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa3b2-8712-4760-8260-ab001b7ce1cc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.099273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e1559-8373-4130-b0cb-3dae87638124 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.122121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:00.128341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103252f-0767-444d-b09c-40c696cb7f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.128998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103252f-0767-444d-b09c-40c696cb7f71 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.129321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103252f-0767-444d-b09c-40c696cb7f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.129623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103252f-0767-444d-b09c-40c696cb7f71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.138036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103252f-0767-444d-b09c-40c696cb7f71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.139598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103252f-0767-444d-b09c-40c696cb7f71 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.155012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da56dbe-e9e7-40b2-96d4-779dee674eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a103252f-0767-444d-b09c-40c696cb7f71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:00.155221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:00.156135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 232/489] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Aug 31 10:58:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:00.158523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15026f-f382-45c3-952c-71524c438ac4 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.159167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15026f-f382-45c3-952c-71524c438ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.159167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15026f-f382-45c3-952c-71524c438ac4 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.160248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da56dbe-e9e7-40b2-96d4-779dee674eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.160353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 233/490] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:00.160857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da56dbe-e9e7-40b2-96d4-779dee674eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.161340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da56dbe-e9e7-40b2-96d4-779dee674eb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.165388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15026f-f382-45c3-952c-71524c438ac4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.174428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da56dbe-e9e7-40b2-96d4-779dee674eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9da56dbe-e9e7-40b2-96d4-779dee674eb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:00.180426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:00.181375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:00.182163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 258/491] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:58:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:00.183353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d28b6c-ddeb-4347-ba37-1a9facc32947 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.183353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d28b6c-ddeb-4347-ba37-1a9facc32947 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.183594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d28b6c-ddeb-4347-ba37-1a9facc32947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.202384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e8d28b6c-ddeb-4347-ba37-1a9facc32947 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:00.203525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e8d28b6c-ddeb-4347-ba37-1a9facc32947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:00.291964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 259/492] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:00.291964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb10d8-f26b-41da-99b8-da01192d9afe None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.291964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb10d8-f26b-41da-99b8-da01192d9afe None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.291964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb10d8-f26b-41da-99b8-da01192d9afe None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.291964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 260/493] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:00.291964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb10d8-f26b-41da-99b8-da01192d9afe None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.318063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15026f-f382-45c3-952c-71524c438ac4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.362108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd069f8-3628-4cd3-9f19-c9b389ec0d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.362893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd069f8-3628-4cd3-9f19-c9b389ec0d4e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.363216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd069f8-3628-4cd3-9f19-c9b389ec0d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.364103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd069f8-3628-4cd3-9f19-c9b389ec0d4e None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.365159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd069f8-3628-4cd3-9f19-c9b389ec0d4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:00.365477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd069f8-3628-4cd3-9f19-c9b389ec0d4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.367137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd069f8-3628-4cd3-9f19-c9b389ec0d4e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.412271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:00.424305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 234/494] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:00.426994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf6a5-689b-47b0-8f11-f3487a98553b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.426994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf6a5-689b-47b0-8f11-f3487a98553b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.426994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf6a5-689b-47b0-8f11-f3487a98553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.446580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7abdf6a5-689b-47b0-8f11-f3487a98553b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:00.447958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7abdf6a5-689b-47b0-8f11-f3487a98553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:00.468143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb10d8-f26b-41da-99b8-da01192d9afe None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.498047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:00.511264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192255c-1f88-48be-8611-e1582c21c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.517266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192255c-1f88-48be-8611-e1582c21c23d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.517266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192255c-1f88-48be-8611-e1582c21c23d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.517266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192255c-1f88-48be-8611-e1582c21c23d None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.517266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192255c-1f88-48be-8611-e1582c21c23d None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:00.517266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192255c-1f88-48be-8611-e1582c21c23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.517266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192255c-1f88-48be-8611-e1582c21c23d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.527779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 235/495] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:00.527779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf6a5-689b-47b0-8f11-f3487a98553b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.531140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 261/496] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:00.536892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192255c-1f88-48be-8611-e1582c21c23d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.633546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf6a5-689b-47b0-8f11-f3487a98553b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.671901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa879-46a8-41aa-acd7-b4259dcee645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.673042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa879-46a8-41aa-acd7-b4259dcee645 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.673319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa879-46a8-41aa-acd7-b4259dcee645 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.673592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa879-46a8-41aa-acd7-b4259dcee645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.702881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192255c-1f88-48be-8611-e1582c21c23d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.748508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:00.749100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:00.750958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa879-46a8-41aa-acd7-b4259dcee645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.752507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa879-46a8-41aa-acd7-b4259dcee645 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.753740 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c347692-7ea1-44ea-84d3-9ea94a793f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.754446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c347692-7ea1-44ea-84d3-9ea94a793f6a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.754796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c347692-7ea1-44ea-84d3-9ea94a793f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.755130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c347692-7ea1-44ea-84d3-9ea94a793f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.767406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c347692-7ea1-44ea-84d3-9ea94a793f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.769123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c347692-7ea1-44ea-84d3-9ea94a793f6a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3c347692-7ea1-44ea-84d3-9ea94a793f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:00.784248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:00.785455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:00.786532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:00.786532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:00.786532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:00.787812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 262/497] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:00.788255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c347692-7ea1-44ea-84d3-9ea94a793f6a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.867528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 236/498] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:00.868422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa879-46a8-41aa-acd7-b4259dcee645 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.912117 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c347692-7ea1-44ea-84d3-9ea94a793f6a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.952681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687232e-7eb2-45ba-b5f7-3799be9edb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.953329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687232e-7eb2-45ba-b5f7-3799be9edb4a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.953633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687232e-7eb2-45ba-b5f7-3799be9edb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.953934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687232e-7eb2-45ba-b5f7-3799be9edb4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.964824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:00.965527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687232e-7eb2-45ba-b5f7-3799be9edb4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9687232e-7eb2-45ba-b5f7-3799be9edb4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:00.972082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:00.973084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:00.973900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:00.978170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 263/499] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:00.980924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687232e-7eb2-45ba-b5f7-3799be9edb4a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.990457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa879-46a8-41aa-acd7-b4259dcee645 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.028611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.035642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243924-93aa-4cae-bc7a-131a48c2c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.041461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243924-93aa-4cae-bc7a-131a48c2c579 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.041461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243924-93aa-4cae-bc7a-131a48c2c579 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.041461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32243924-93aa-4cae-bc7a-131a48c2c579 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.041461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32243924-93aa-4cae-bc7a-131a48c2c579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:01.041461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32243924-93aa-4cae-bc7a-131a48c2c579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.041461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32243924-93aa-4cae-bc7a-131a48c2c579 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.058227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 237/500] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:01.059078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243924-93aa-4cae-bc7a-131a48c2c579 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.103628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687232e-7eb2-45ba-b5f7-3799be9edb4a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.145548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59724407-adfc-4654-9e12-1d1294eefb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.146190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59724407-adfc-4654-9e12-1d1294eefb44 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.146471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59724407-adfc-4654-9e12-1d1294eefb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.146746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59724407-adfc-4654-9e12-1d1294eefb44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.159432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59724407-adfc-4654-9e12-1d1294eefb44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-59724407-adfc-4654-9e12-1d1294eefb44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:01.164781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:01.166006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:01.166810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:01.171047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 264/501] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:01.171880 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59724407-adfc-4654-9e12-1d1294eefb44 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.203873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32243924-93aa-4cae-bc7a-131a48c2c579 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.246037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b4030-6dd4-48ee-aefa-ebf2cf8112b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.246037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4030-6dd4-48ee-aefa-ebf2cf8112b0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.246037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4030-6dd4-48ee-aefa-ebf2cf8112b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.246037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4030-6dd4-48ee-aefa-ebf2cf8112b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.257507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.260361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b4030-6dd4-48ee-aefa-ebf2cf8112b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.262199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b4030-6dd4-48ee-aefa-ebf2cf8112b0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-868b4030-6dd4-48ee-aefa-ebf2cf8112b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:01.278838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:01.280494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:01.282572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:01.282572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:01.282572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:01.283729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 238/502] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:01.288755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b4030-6dd4-48ee-aefa-ebf2cf8112b0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.312850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59724407-adfc-4654-9e12-1d1294eefb44 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.319274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.357345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2e93-96fd-40c7-a2f8-a0026f0e7374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.358320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2e93-96fd-40c7-a2f8-a0026f0e7374 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.358587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2e93-96fd-40c7-a2f8-a0026f0e7374 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.358856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2e93-96fd-40c7-a2f8-a0026f0e7374 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.359521 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f2e93-96fd-40c7-a2f8-a0026f0e7374 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:01.360749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f2e93-96fd-40c7-a2f8-a0026f0e7374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.362050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f2e93-96fd-40c7-a2f8-a0026f0e7374 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.375410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 265/503] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:01.375410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2e93-96fd-40c7-a2f8-a0026f0e7374 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.417029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b4030-6dd4-48ee-aefa-ebf2cf8112b0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.451991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3d1a0-c5e2-4df6-bce7-2cd7c678f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.452621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d1a0-c5e2-4df6-bce7-2cd7c678f185 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.452907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d1a0-c5e2-4df6-bce7-2cd7c678f185 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.453178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d1a0-c5e2-4df6-bce7-2cd7c678f185 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.461479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3d1a0-c5e2-4df6-bce7-2cd7c678f185 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.462952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3d1a0-c5e2-4df6-bce7-2cd7c678f185 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-5cd3d1a0-c5e2-4df6-bce7-2cd7c678f185 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:01.474943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:01.475967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 239/504] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:01.476896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3d1a0-c5e2-4df6-bce7-2cd7c678f185 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.496604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2e93-96fd-40c7-a2f8-a0026f0e7374 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.532985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba84b5-8179-49b5-b2d7-5b933f7010f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.533556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba84b5-8179-49b5-b2d7-5b933f7010f7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.533833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba84b5-8179-49b5-b2d7-5b933f7010f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.534106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba84b5-8179-49b5-b2d7-5b933f7010f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.534774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba84b5-8179-49b5-b2d7-5b933f7010f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:01.535075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba84b5-8179-49b5-b2d7-5b933f7010f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.536500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba84b5-8179-49b5-b2d7-5b933f7010f7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.544717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 266/505] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:01.546078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173285e-7aa9-4200-b5f0-3f13b898155c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.546365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173285e-7aa9-4200-b5f0-3f13b898155c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.546639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173285e-7aa9-4200-b5f0-3f13b898155c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.551799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 267/506] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:01.551799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173285e-7aa9-4200-b5f0-3f13b898155c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.552647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.579141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.601991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3d1a0-c5e2-4df6-bce7-2cd7c678f185 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.651764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc07043-dc6a-4160-afdc-d5df46555156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.652745 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc07043-dc6a-4160-afdc-d5df46555156 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.653208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc07043-dc6a-4160-afdc-d5df46555156 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.653660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc07043-dc6a-4160-afdc-d5df46555156 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.654710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc07043-dc6a-4160-afdc-d5df46555156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:01.655174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc07043-dc6a-4160-afdc-d5df46555156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.657588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc07043-dc6a-4160-afdc-d5df46555156 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.674405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173285e-7aa9-4200-b5f0-3f13b898155c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.682794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 240/507] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:01.682794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc07043-dc6a-4160-afdc-d5df46555156 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.714524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f997a9-ca22-4ecb-b043-6904b386b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.715156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f997a9-ca22-4ecb-b043-6904b386b09c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.715427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f997a9-ca22-4ecb-b043-6904b386b09c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.715929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f997a9-ca22-4ecb-b043-6904b386b09c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.727526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f997a9-ca22-4ecb-b043-6904b386b09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.729021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f997a9-ca22-4ecb-b043-6904b386b09c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c6f997a9-ca22-4ecb-b043-6904b386b09c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:01.749065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:01.750508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:01.751351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:01.751351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:01.751351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:01.751351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 268/508] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:01.752110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f997a9-ca22-4ecb-b043-6904b386b09c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.799601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc07043-dc6a-4160-afdc-d5df46555156 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.815662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.837516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1153b3-006b-4308-99aa-804284953799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.838124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1153b3-006b-4308-99aa-804284953799 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.838403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1153b3-006b-4308-99aa-804284953799 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.838676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1153b3-006b-4308-99aa-804284953799 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.839410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1153b3-006b-4308-99aa-804284953799 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:01.839713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1153b3-006b-4308-99aa-804284953799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.841192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1153b3-006b-4308-99aa-804284953799 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.841355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.861234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 241/509] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:01.862522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f3a95-a179-4977-a6d5-1806f3cd511f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.862807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f3a95-a179-4977-a6d5-1806f3cd511f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.863078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f3a95-a179-4977-a6d5-1806f3cd511f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.870023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f997a9-ca22-4ecb-b043-6904b386b09c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.881721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-772f3a95-a179-4977-a6d5-1806f3cd511f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:01.883025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-772f3a95-a179-4977-a6d5-1806f3cd511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:01.910256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d365a-338d-432b-9253-cefaea3c06a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.910982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d365a-338d-432b-9253-cefaea3c06a3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.911269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d365a-338d-432b-9253-cefaea3c06a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.911540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d365a-338d-432b-9253-cefaea3c06a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.923189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d365a-338d-432b-9253-cefaea3c06a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.924790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d365a-338d-432b-9253-cefaea3c06a3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-496d365a-338d-432b-9253-cefaea3c06a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:01.940246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:01.941431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:01.942295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:01.942295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:01.942295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:01.942295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 269/510] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:01.942508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d365a-338d-432b-9253-cefaea3c06a3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.960952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 242/511] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:01.961914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f3a95-a179-4977-a6d5-1806f3cd511f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.066612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d365a-338d-432b-9253-cefaea3c06a3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:02.083369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:02.086936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f3a95-a179-4977-a6d5-1806f3cd511f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:02.103552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:02.111829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61edd-28d9-4d52-bc92-59034d7a62a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:02.112890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61edd-28d9-4d52-bc92-59034d7a62a6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.113426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61edd-28d9-4d52-bc92-59034d7a62a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.113872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61edd-28d9-4d52-bc92-59034d7a62a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.123111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61edd-28d9-4d52-bc92-59034d7a62a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:02.124591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61edd-28d9-4d52-bc92-59034d7a62a6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:02.126612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8a94a-16ef-483c-a8b3-0610493c1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:02.127805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a94a-16ef-483c-a8b3-0610493c1f65 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.128275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a94a-16ef-483c-a8b3-0610493c1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.128771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8a94a-16ef-483c-a8b3-0610493c1f65 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.129632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8a94a-16ef-483c-a8b3-0610493c1f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:02.130119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8a94a-16ef-483c-a8b3-0610493c1f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:02.132055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8a94a-16ef-483c-a8b3-0610493c1f65 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-bdf61edd-28d9-4d52-bc92-59034d7a62a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:02.136670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:02.137567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:02.138440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:02.138440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:02.138440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:02.138440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:02.138440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:02.138440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:02.138440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:02.138440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:02.138440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 270/512] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:02.138945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61edd-28d9-4d52-bc92-59034d7a62a6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.157890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 243/513] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:02.157890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8a94a-16ef-483c-a8b3-0610493c1f65 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.278065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61edd-28d9-4d52-bc92-59034d7a62a6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:02.279116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8a94a-16ef-483c-a8b3-0610493c1f65 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:02.316131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb33cbd-50ef-4d18-91fa-c01a4dc8eb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:02.316824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb33cbd-50ef-4d18-91fa-c01a4dc8eb60 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.317036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb33cbd-50ef-4d18-91fa-c01a4dc8eb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.317309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb33cbd-50ef-4d18-91fa-c01a4dc8eb60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.317867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ef79-061a-4ecf-bca8-96062c25cac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:02.318477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ef79-061a-4ecf-bca8-96062c25cac5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.318755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ef79-061a-4ecf-bca8-96062c25cac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.319028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ef79-061a-4ecf-bca8-96062c25cac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.319684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6ef79-061a-4ecf-bca8-96062c25cac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:02.320017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6ef79-061a-4ecf-bca8-96062c25cac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:02.321414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6ef79-061a-4ecf-bca8-96062c25cac5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:02.335678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 244/514] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:02.336578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ef79-061a-4ecf-bca8-96062c25cac5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.361996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:02.382657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:02.392768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb33cbd-50ef-4d18-91fa-c01a4dc8eb60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:02.394236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb33cbd-50ef-4d18-91fa-c01a4dc8eb60 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:02.445936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ef79-061a-4ecf-bca8-96062c25cac5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:02.481971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2572406-94d0-41d4-a978-e925c23cb62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:02.482603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2572406-94d0-41d4-a978-e925c23cb62d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.482887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2572406-94d0-41d4-a978-e925c23cb62d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.483160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2572406-94d0-41d4-a978-e925c23cb62d None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.483883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2572406-94d0-41d4-a978-e925c23cb62d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:02.484189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2572406-94d0-41d4-a978-e925c23cb62d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:02.485729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2572406-94d0-41d4-a978-e925c23cb62d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:02.503737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 245/515] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:02.504572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2572406-94d0-41d4-a978-e925c23cb62d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.510090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 271/516] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:02.510090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb33cbd-50ef-4d18-91fa-c01a4dc8eb60 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.595131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:02.614829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:02.615143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2572406-94d0-41d4-a978-e925c23cb62d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:02.624609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb33cbd-50ef-4d18-91fa-c01a4dc8eb60 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:02.654339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b774dc-affb-4d74-a5f8-02f01291c6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:02.654975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b774dc-affb-4d74-a5f8-02f01291c6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.655256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b774dc-affb-4d74-a5f8-02f01291c6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.655529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b774dc-affb-4d74-a5f8-02f01291c6c2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.661381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f24a4-0766-459f-8033-e1e146f5751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:02.662021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f24a4-0766-459f-8033-e1e146f5751a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.662293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f24a4-0766-459f-8033-e1e146f5751a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.662566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f24a4-0766-459f-8033-e1e146f5751a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.663558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b774dc-affb-4d74-a5f8-02f01291c6c2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:02.665066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b774dc-affb-4d74-a5f8-02f01291c6c2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:02.673777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f24a4-0766-459f-8033-e1e146f5751a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:02.675261 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f24a4-0766-459f-8033-e1e146f5751a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-57b774dc-affb-4d74-a5f8-02f01291c6c2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:02.677936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:02.679259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 246/517] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:02.680230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b774dc-affb-4d74-a5f8-02f01291c6c2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b20f24a4-0766-459f-8033-e1e146f5751a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:02.697445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:02.698409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:02.699290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:02.699290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:02.699290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:02.699290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 272/518] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:02.699501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f24a4-0766-459f-8033-e1e146f5751a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.809104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b774dc-affb-4d74-a5f8-02f01291c6c2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:02.817285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f24a4-0766-459f-8033-e1e146f5751a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:02.845983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9389aa-7b24-4591-bf09-e3901f48548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:02.846532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9389aa-7b24-4591-bf09-e3901f48548d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.846808 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9389aa-7b24-4591-bf09-e3901f48548d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.847083 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9389aa-7b24-4591-bf09-e3901f48548d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.853608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d94164-9c96-42bf-9d1c-a46c26ed9175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:02.854217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d94164-9c96-42bf-9d1c-a46c26ed9175 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.854665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d94164-9c96-42bf-9d1c-a46c26ed9175 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.854809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d94164-9c96-42bf-9d1c-a46c26ed9175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.855509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9389aa-7b24-4591-bf09-e3901f48548d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:02.855671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d94164-9c96-42bf-9d1c-a46c26ed9175 None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=c9c5d8bbcf07486ea3d3e26c81135d2f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:02.855825 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d94164-9c96-42bf-9d1c-a46c26ed9175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:02.857011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9389aa-7b24-4591-bf09-e3901f48548d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:02.857251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d94164-9c96-42bf-9d1c-a46c26ed9175 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:02.862388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:02.864564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 273/519] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/role_assignments?user.id=c9c5d8bbcf07486ea3d3e26c81135d2f&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:02.866487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d94164-9c96-42bf-9d1c-a46c26ed9175 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-be9389aa-7b24-4591-bf09-e3901f48548d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:02.872895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:02.874701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 247/520] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:02.877363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9389aa-7b24-4591-bf09-e3901f48548d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.895253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.017697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9389aa-7b24-4591-bf09-e3901f48548d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.017907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d94164-9c96-42bf-9d1c-a46c26ed9175 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.057169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c8b6c-4d6d-4690-9cb7-06fa315ad63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.057786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c8b6c-4d6d-4690-9cb7-06fa315ad63c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.058066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c8b6c-4d6d-4690-9cb7-06fa315ad63c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.058338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c8b6c-4d6d-4690-9cb7-06fa315ad63c None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.059074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c8b6c-4d6d-4690-9cb7-06fa315ad63c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:03.059185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90abfa-7fb0-4481-8f57-d6c8ec681c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.059379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c8b6c-4d6d-4690-9cb7-06fa315ad63c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.059833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90abfa-7fb0-4481-8f57-d6c8ec681c68 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.060114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90abfa-7fb0-4481-8f57-d6c8ec681c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.060385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90abfa-7fb0-4481-8f57-d6c8ec681c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.060895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c8b6c-4d6d-4690-9cb7-06fa315ad63c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.074769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90abfa-7fb0-4481-8f57-d6c8ec681c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.076276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90abfa-7fb0-4481-8f57-d6c8ec681c68 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.088124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 248/521] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:03.088124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c8b6c-4d6d-4690-9cb7-06fa315ad63c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8f90abfa-7fb0-4481-8f57-d6c8ec681c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:03.097919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:03.098838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:03.099815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:03.099815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:03.099815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:03.099815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 274/522] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:03.099815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90abfa-7fb0-4481-8f57-d6c8ec681c68 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.161091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.166532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.210776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90abfa-7fb0-4481-8f57-d6c8ec681c68 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.218570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c8b6c-4d6d-4690-9cb7-06fa315ad63c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.261892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2badb17-fa04-4277-8d89-6c132e517a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.262991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2badb17-fa04-4277-8d89-6c132e517a3a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.263274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2badb17-fa04-4277-8d89-6c132e517a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.263841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2badb17-fa04-4277-8d89-6c132e517a3a None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.264720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2badb17-fa04-4277-8d89-6c132e517a3a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:03.265173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2badb17-fa04-4277-8d89-6c132e517a3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.267144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2badb17-fa04-4277-8d89-6c132e517a3a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.280213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983495-f18e-4efc-af89-fa09682319f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.283689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983495-f18e-4efc-af89-fa09682319f2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.284246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983495-f18e-4efc-af89-fa09682319f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.284943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983495-f18e-4efc-af89-fa09682319f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.286153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983495-f18e-4efc-af89-fa09682319f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:03.286840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983495-f18e-4efc-af89-fa09682319f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.290557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983495-f18e-4efc-af89-fa09682319f2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.319162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 249/523] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:03.319162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983495-f18e-4efc-af89-fa09682319f2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.327983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 275/524] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Aug 31 10:59:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:03.327983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2badb17-fa04-4277-8d89-6c132e517a3a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.441001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983495-f18e-4efc-af89-fa09682319f2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.457168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2badb17-fa04-4277-8d89-6c132e517a3a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.460461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.478091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329da4f-762d-41c4-b2ba-c496215c0e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.480395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329da4f-762d-41c4-b2ba-c496215c0e90 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.480395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329da4f-762d-41c4-b2ba-c496215c0e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.480395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329da4f-762d-41c4-b2ba-c496215c0e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.482107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.499231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c973e17-c63f-4edf-adb7-9412896c6ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.499874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c973e17-c63f-4edf-adb7-9412896c6ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.500151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c973e17-c63f-4edf-adb7-9412896c6ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.500458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c973e17-c63f-4edf-adb7-9412896c6ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.501108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c973e17-c63f-4edf-adb7-9412896c6ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:03.501406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c973e17-c63f-4edf-adb7-9412896c6ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.502798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c973e17-c63f-4edf-adb7-9412896c6ac1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.514689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 276/525] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:03.515679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c973e17-c63f-4edf-adb7-9412896c6ac1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.568259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329da4f-762d-41c4-b2ba-c496215c0e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.569736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329da4f-762d-41c4-b2ba-c496215c0e90 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.655023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c973e17-c63f-4edf-adb7-9412896c6ac1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.695465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553df6a-3d56-42a2-b97e-78e01111a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.696456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553df6a-3d56-42a2-b97e-78e01111a2bc None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.696845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 250/526] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:03.697104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553df6a-3d56-42a2-b97e-78e01111a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.697585 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553df6a-3d56-42a2-b97e-78e01111a2bc None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.697686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329da4f-762d-41c4-b2ba-c496215c0e90 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.698482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553df6a-3d56-42a2-b97e-78e01111a2bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.700320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553df6a-3d56-42a2-b97e-78e01111a2bc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.723305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.809343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329da4f-762d-41c4-b2ba-c496215c0e90 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.819784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 277/527] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:59:03 2022] POST /identity/v3/users => generated 247 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:03.819784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553df6a-3d56-42a2-b97e-78e01111a2bc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.864258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca149c-fb88-4c76-8c79-69ee95641477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.864882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca149c-fb88-4c76-8c79-69ee95641477 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.865164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca149c-fb88-4c76-8c79-69ee95641477 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.865438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca149c-fb88-4c76-8c79-69ee95641477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.875922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.958596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca149c-fb88-4c76-8c79-69ee95641477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.960034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca149c-fb88-4c76-8c79-69ee95641477 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.991452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553df6a-3d56-42a2-b97e-78e01111a2bc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.992540 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.037679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565147e-2c85-4052-929f-ca7494f7f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.038312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565147e-2c85-4052-929f-ca7494f7f15f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.038588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565147e-2c85-4052-929f-ca7494f7f15f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.038856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565147e-2c85-4052-929f-ca7494f7f15f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.045958 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565147e-2c85-4052-929f-ca7494f7f15f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.047677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565147e-2c85-4052-929f-ca7494f7f15f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4565147e-2c85-4052-929f-ca7494f7f15f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:04.068375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:04.069332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:04.070381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:04.070381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:04.070381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:04.070381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:04.070381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:04.070381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:04.070381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:04.070381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:04.070381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 278/528] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:04.070853 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565147e-2c85-4052-929f-ca7494f7f15f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.102963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 251/529] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:04.104301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca149c-fb88-4c76-8c79-69ee95641477 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.203722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.212513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565147e-2c85-4052-929f-ca7494f7f15f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.257502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eb363-941c-4dec-90bf-84f8e3f545a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.258149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eb363-941c-4dec-90bf-84f8e3f545a1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.258426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eb363-941c-4dec-90bf-84f8e3f545a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.258647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca149c-fb88-4c76-8c79-69ee95641477 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.258757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eb363-941c-4dec-90bf-84f8e3f545a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.272908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eb363-941c-4dec-90bf-84f8e3f545a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.275029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eb363-941c-4dec-90bf-84f8e3f545a1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.282456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-482eb363-941c-4dec-90bf-84f8e3f545a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:04.295397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:04.302833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:04.303978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:04.303978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:04.303978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:04.303978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 279/530] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:04.303978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eb363-941c-4dec-90bf-84f8e3f545a1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.317611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1267ee8-17ce-4dc8-a78a-fc0076ca56b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.318638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1267ee8-17ce-4dc8-a78a-fc0076ca56b7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.319143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1267ee8-17ce-4dc8-a78a-fc0076ca56b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.319627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1267ee8-17ce-4dc8-a78a-fc0076ca56b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.320552 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1267ee8-17ce-4dc8-a78a-fc0076ca56b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:04.321058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1267ee8-17ce-4dc8-a78a-fc0076ca56b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.322769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1267ee8-17ce-4dc8-a78a-fc0076ca56b7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.343376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 252/531] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:04.345965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1267ee8-17ce-4dc8-a78a-fc0076ca56b7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.451100 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eb363-941c-4dec-90bf-84f8e3f545a1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.494047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1267ee8-17ce-4dc8-a78a-fc0076ca56b7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.494549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397b9e-dd8b-4bf8-9221-f3a77d2970ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.495295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397b9e-dd8b-4bf8-9221-f3a77d2970ec None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.495804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397b9e-dd8b-4bf8-9221-f3a77d2970ec None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.496376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0397b9e-dd8b-4bf8-9221-f3a77d2970ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.509979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0397b9e-dd8b-4bf8-9221-f3a77d2970ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.512290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0397b9e-dd8b-4bf8-9221-f3a77d2970ec None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.525110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a0397b9e-dd8b-4bf8-9221-f3a77d2970ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:04.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:04.538896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:04.539766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:04.539766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:04.539766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:04.540315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 280/532] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:04.541567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397b9e-dd8b-4bf8-9221-f3a77d2970ec None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.547832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34850581-1cbb-46cf-9006-8e61584ec655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.549345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850581-1cbb-46cf-9006-8e61584ec655 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.549908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850581-1cbb-46cf-9006-8e61584ec655 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.551303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850581-1cbb-46cf-9006-8e61584ec655 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.552269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34850581-1cbb-46cf-9006-8e61584ec655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:04.552761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34850581-1cbb-46cf-9006-8e61584ec655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.554618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34850581-1cbb-46cf-9006-8e61584ec655 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.577328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 253/533] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:04.577328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34850581-1cbb-46cf-9006-8e61584ec655 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.630140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.704549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0397b9e-dd8b-4bf8-9221-f3a77d2970ec None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.717996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34850581-1cbb-46cf-9006-8e61584ec655 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.744399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b26245-7222-4713-8e24-5967e8d77854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.745361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b26245-7222-4713-8e24-5967e8d77854 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.745918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b26245-7222-4713-8e24-5967e8d77854 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.746405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b26245-7222-4713-8e24-5967e8d77854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.747346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b26245-7222-4713-8e24-5967e8d77854 None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=a8855e3e7fc84cd9ba1afaef4cc308c5) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:04.747937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b26245-7222-4713-8e24-5967e8d77854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.749676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b26245-7222-4713-8e24-5967e8d77854 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.757103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 281/534] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/role_assignments?user.id=a8855e3e7fc84cd9ba1afaef4cc308c5&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:04.758386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b26245-7222-4713-8e24-5967e8d77854 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.762157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3da96-6935-493d-a49b-576bd36760c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.762871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3da96-6935-493d-a49b-576bd36760c4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.763152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3da96-6935-493d-a49b-576bd36760c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.763440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3da96-6935-493d-a49b-576bd36760c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.769396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3da96-6935-493d-a49b-576bd36760c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:04.769396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3da96-6935-493d-a49b-576bd36760c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.769396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3da96-6935-493d-a49b-576bd36760c4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.784148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 254/535] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:04.790966 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3da96-6935-493d-a49b-576bd36760c4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.924275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.933076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.937136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3da96-6935-493d-a49b-576bd36760c4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.977143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b26245-7222-4713-8e24-5967e8d77854 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.978596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e84762-7f29-4e07-9d91-48637e2f318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.979429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84762-7f29-4e07-9d91-48637e2f318d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.979994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84762-7f29-4e07-9d91-48637e2f318d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.980383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84762-7f29-4e07-9d91-48637e2f318d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.992200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e84762-7f29-4e07-9d91-48637e2f318d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.995602 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e84762-7f29-4e07-9d91-48637e2f318d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-37e84762-7f29-4e07-9d91-48637e2f318d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:05.011223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:05.012447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:05.013335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:05.013335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:05.013335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:05.013335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:05.013335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:05.013335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:05.013335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:05.013335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:05.022420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 255/536] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:05.022420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c308e-9bbd-4806-a44a-4ef5599f7e9b None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.022420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c308e-9bbd-4806-a44a-4ef5599f7e9b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.022420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c308e-9bbd-4806-a44a-4ef5599f7e9b None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.022420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 256/537] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:05.023211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c308e-9bbd-4806-a44a-4ef5599f7e9b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.037714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1195e-1edb-4fbf-9e3b-3a1e43688f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.038358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1195e-1edb-4fbf-9e3b-3a1e43688f69 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.039213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1195e-1edb-4fbf-9e3b-3a1e43688f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.039481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1195e-1edb-4fbf-9e3b-3a1e43688f69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.049821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1195e-1edb-4fbf-9e3b-3a1e43688f69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.051300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1195e-1edb-4fbf-9e3b-3a1e43688f69 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6fd1195e-1edb-4fbf-9e3b-3a1e43688f69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:05.067425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:05.068743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 282/538] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3d643-de23-4ae3-9b76-ea12b4e6e6f3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.070525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3d643-de23-4ae3-9b76-ea12b4e6e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.071641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3d643-de23-4ae3-9b76-ea12b4e6e6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.096219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-80e3d643-de23-4ae3-9b76-ea12b4e6e6f3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:05.097521 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-80e3d643-de23-4ae3-9b76-ea12b4e6e6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:05.176962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c308e-9bbd-4806-a44a-4ef5599f7e9b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.190039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 283/539] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:05.190975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3d643-de23-4ae3-9b76-ea12b4e6e6f3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.234240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea447d06-a27a-4d03-b341-f28af1e119c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.236069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea447d06-a27a-4d03-b341-f28af1e119c9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.236574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea447d06-a27a-4d03-b341-f28af1e119c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.236750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea447d06-a27a-4d03-b341-f28af1e119c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.237414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea447d06-a27a-4d03-b341-f28af1e119c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:05.237790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea447d06-a27a-4d03-b341-f28af1e119c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.239284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea447d06-a27a-4d03-b341-f28af1e119c9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.255666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 257/540] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:05.264833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea447d06-a27a-4d03-b341-f28af1e119c9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.273643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:05.311022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:05.376512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3d643-de23-4ae3-9b76-ea12b4e6e6f3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.462468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5915fd-9217-4c49-a7b9-671b86881be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.463100 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5915fd-9217-4c49-a7b9-671b86881be8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.463379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5915fd-9217-4c49-a7b9-671b86881be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.463647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5915fd-9217-4c49-a7b9-671b86881be8 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.464389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5915fd-9217-4c49-a7b9-671b86881be8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:05.464695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5915fd-9217-4c49-a7b9-671b86881be8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.466169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5915fd-9217-4c49-a7b9-671b86881be8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.496994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea447d06-a27a-4d03-b341-f28af1e119c9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.518979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 284/541] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:05.524723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5915fd-9217-4c49-a7b9-671b86881be8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.538449 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff307a-7fa8-49d4-a6fd-7ec470c505c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.539395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff307a-7fa8-49d4-a6fd-7ec470c505c6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.539894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff307a-7fa8-49d4-a6fd-7ec470c505c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.540345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff307a-7fa8-49d4-a6fd-7ec470c505c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.541260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff307a-7fa8-49d4-a6fd-7ec470c505c6 None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=fae0faf062ba4b7a8270fc2ff92a10be) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:05.541747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff307a-7fa8-49d4-a6fd-7ec470c505c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.543369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff307a-7fa8-49d4-a6fd-7ec470c505c6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.550680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 258/542] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/role_assignments?user.id=fae0faf062ba4b7a8270fc2ff92a10be&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:05.556843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff307a-7fa8-49d4-a6fd-7ec470c505c6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.714329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:05.753000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5915fd-9217-4c49-a7b9-671b86881be8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.760595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff307a-7fa8-49d4-a6fd-7ec470c505c6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.785460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:05.818266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a12ff-dcaf-48cb-89b8-7ec1c389e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.819256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a12ff-dcaf-48cb-89b8-7ec1c389e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.819709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a12ff-dcaf-48cb-89b8-7ec1c389e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.820170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a12ff-dcaf-48cb-89b8-7ec1c389e2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.821421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a12ff-dcaf-48cb-89b8-7ec1c389e2c7 None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=041de16601f342c1a9b18003773a0856) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:05.821555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4b6c-9020-47e8-89ff-bfeff57f3f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.821939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a12ff-dcaf-48cb-89b8-7ec1c389e2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.822047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4b6c-9020-47e8-89ff-bfeff57f3f57 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.822423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4b6c-9020-47e8-89ff-bfeff57f3f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.822704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da4b6c-9020-47e8-89ff-bfeff57f3f57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.824567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a12ff-dcaf-48cb-89b8-7ec1c389e2c7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.836060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 285/543] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/role_assignments?user.id=041de16601f342c1a9b18003773a0856&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:05.837669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da4b6c-9020-47e8-89ff-bfeff57f3f57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-15da4b6c-9020-47e8-89ff-bfeff57f3f57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:05.843240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:05.844393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:05.845181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 259/544] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:05.852880 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a12ff-dcaf-48cb-89b8-7ec1c389e2c7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.059249 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a12ff-dcaf-48cb-89b8-7ec1c389e2c7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.113584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cf6c7-9982-42f0-af2d-327d250f1d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.114207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cf6c7-9982-42f0-af2d-327d250f1d33 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.114485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cf6c7-9982-42f0-af2d-327d250f1d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.114760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cf6c7-9982-42f0-af2d-327d250f1d33 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.115432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cf6c7-9982-42f0-af2d-327d250f1d33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:06.115736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cf6c7-9982-42f0-af2d-327d250f1d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.117138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cf6c7-9982-42f0-af2d-327d250f1d33 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.133484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 286/545] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:06.140584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4b6c-9020-47e8-89ff-bfeff57f3f57 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.262486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da4b6c-9020-47e8-89ff-bfeff57f3f57 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.287147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53bde7-fd6f-458a-91a4-c03dddd402d3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.287493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53bde7-fd6f-458a-91a4-c03dddd402d3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.287701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53bde7-fd6f-458a-91a4-c03dddd402d3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.289289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 287/546] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:06.294892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba324141-4934-47f3-8ae7-9ebf07ae4709 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.295175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba324141-4934-47f3-8ae7-9ebf07ae4709 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.295444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba324141-4934-47f3-8ae7-9ebf07ae4709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.308538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6dba1-29bd-4139-9be5-58964d90ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.309588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6dba1-29bd-4139-9be5-58964d90ca73 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.310838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6dba1-29bd-4139-9be5-58964d90ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.311124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6dba1-29bd-4139-9be5-58964d90ca73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.323391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ba324141-4934-47f3-8ae7-9ebf07ae4709 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:06.324640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ba324141-4934-47f3-8ae7-9ebf07ae4709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:06.340163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6dba1-29bd-4139-9be5-58964d90ca73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.341645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6dba1-29bd-4139-9be5-58964d90ca73 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.352134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-78d6dba1-29bd-4139-9be5-58964d90ca73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:06.369916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:06.372109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:06.374889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:06.374889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:06.374889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:06.374889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 260/547] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:06.381743 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6dba1-29bd-4139-9be5-58964d90ca73 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.387962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:06.465939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 288/548] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:06.549366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6dba1-29bd-4139-9be5-58964d90ca73 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.587481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71bf2c-6704-4286-b02d-7510de4876ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.588009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71bf2c-6704-4286-b02d-7510de4876ff None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.588352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71bf2c-6704-4286-b02d-7510de4876ff None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.588813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71bf2c-6704-4286-b02d-7510de4876ff None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.589529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71bf2c-6704-4286-b02d-7510de4876ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:06.589834 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71bf2c-6704-4286-b02d-7510de4876ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.591495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71bf2c-6704-4286-b02d-7510de4876ff None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.613916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 261/549] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:06.619669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba324141-4934-47f3-8ae7-9ebf07ae4709 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.767174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba324141-4934-47f3-8ae7-9ebf07ae4709 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.827337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef688390-c133-44a4-9b27-5e3585e91a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.828420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef688390-c133-44a4-9b27-5e3585e91a1a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.828900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef688390-c133-44a4-9b27-5e3585e91a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.829432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef688390-c133-44a4-9b27-5e3585e91a1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.837899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef688390-c133-44a4-9b27-5e3585e91a1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.839734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef688390-c133-44a4-9b27-5e3585e91a1a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ef688390-c133-44a4-9b27-5e3585e91a1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:06.857965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:06.859062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:06.864706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:06.867250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 289/550] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:06.873026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71bf2c-6704-4286-b02d-7510de4876ff None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.918381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef688390-c133-44a4-9b27-5e3585e91a1a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.966172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:06.995064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:07.040957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef688390-c133-44a4-9b27-5e3585e91a1a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:07.080181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c9f48-17f5-405e-97d7-e557d3922da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:07.081763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c9f48-17f5-405e-97d7-e557d3922da3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.082241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c9f48-17f5-405e-97d7-e557d3922da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.082737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c9f48-17f5-405e-97d7-e557d3922da3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.095183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c9f48-17f5-405e-97d7-e557d3922da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-814c9f48-17f5-405e-97d7-e557d3922da3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:07.101394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:07.102352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:07.103216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:07.105846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 290/551] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:07.115985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c9f48-17f5-405e-97d7-e557d3922da3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:07.119872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71bf2c-6704-4286-b02d-7510de4876ff None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:07.191246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7234e-2b4d-4a1b-90c2-ef86bdb87f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:07.191900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7234e-2b4d-4a1b-90c2-ef86bdb87f83 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.192749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7234e-2b4d-4a1b-90c2-ef86bdb87f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.193073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7234e-2b4d-4a1b-90c2-ef86bdb87f83 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.194028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7234e-2b4d-4a1b-90c2-ef86bdb87f83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:07.194806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7234e-2b4d-4a1b-90c2-ef86bdb87f83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:07.196943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7234e-2b4d-4a1b-90c2-ef86bdb87f83 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:07.223054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 262/552] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:07.225526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2d294-0d00-4140-9eae-10fc6249b3af None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.225808 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2d294-0d00-4140-9eae-10fc6249b3af None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.226088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2d294-0d00-4140-9eae-10fc6249b3af None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.228304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 263/553] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:07.229084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2d294-0d00-4140-9eae-10fc6249b3af None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:07.257877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:07.273541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c9f48-17f5-405e-97d7-e557d3922da3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:07.316803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ae927-1e80-426f-91ed-3b5d1823f75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:07.317704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ae927-1e80-426f-91ed-3b5d1823f75b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.318187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ae927-1e80-426f-91ed-3b5d1823f75b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.318614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ae927-1e80-426f-91ed-3b5d1823f75b None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.319484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ae927-1e80-426f-91ed-3b5d1823f75b None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:07.320087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ae927-1e80-426f-91ed-3b5d1823f75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:07.321663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ae927-1e80-426f-91ed-3b5d1823f75b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:07.338079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 291/554] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:07.338079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99636ffb-3c7e-4a57-b5f1-60ca647bc7d8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.338079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99636ffb-3c7e-4a57-b5f1-60ca647bc7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.338079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99636ffb-3c7e-4a57-b5f1-60ca647bc7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.359372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-99636ffb-3c7e-4a57-b5f1-60ca647bc7d8 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:07.361727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-99636ffb-3c7e-4a57-b5f1-60ca647bc7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:07.381159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2d294-0d00-4140-9eae-10fc6249b3af None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:07.401508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:07.428278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88fe95-ddec-4ab5-8bae-128ca6153059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:07.429585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fe95-ddec-4ab5-8bae-128ca6153059 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.430165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fe95-ddec-4ab5-8bae-128ca6153059 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.430676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fe95-ddec-4ab5-8bae-128ca6153059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.444551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88fe95-ddec-4ab5-8bae-128ca6153059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:07.447636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88fe95-ddec-4ab5-8bae-128ca6153059 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:07.451854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 292/555] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:07.453760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99636ffb-3c7e-4a57-b5f1-60ca647bc7d8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-fb88fe95-ddec-4ab5-8bae-128ca6153059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:07.489186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:07.491114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:07.492804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:07.492804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:07.492804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:07.498547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 264/556] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:07.504463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88fe95-ddec-4ab5-8bae-128ca6153059 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:07.632500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:07.666897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99636ffb-3c7e-4a57-b5f1-60ca647bc7d8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:07.733222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88fe95-ddec-4ab5-8bae-128ca6153059 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:07.734565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9eb34-41fe-4a66-93f8-56d893fdc30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:07.735476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9eb34-41fe-4a66-93f8-56d893fdc30c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.735997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9eb34-41fe-4a66-93f8-56d893fdc30c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.736501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9eb34-41fe-4a66-93f8-56d893fdc30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.758547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9eb34-41fe-4a66-93f8-56d893fdc30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:07.760486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9eb34-41fe-4a66-93f8-56d893fdc30c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4da9eb34-41fe-4a66-93f8-56d893fdc30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:07.793386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:07.794837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:07.795716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:07.795716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:07.795716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:07.799220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 293/557] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:07.803769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9eb34-41fe-4a66-93f8-56d893fdc30c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:07.817763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd6c47-209f-45b4-9e1c-9bafe90991c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:07.818847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd6c47-209f-45b4-9e1c-9bafe90991c5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.819406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd6c47-209f-45b4-9e1c-9bafe90991c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.819921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd6c47-209f-45b4-9e1c-9bafe90991c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.820797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd6c47-209f-45b4-9e1c-9bafe90991c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:07.821399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd6c47-209f-45b4-9e1c-9bafe90991c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:07.823133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd6c47-209f-45b4-9e1c-9bafe90991c5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:07.838635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 265/558] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:07.840101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd6c47-209f-45b4-9e1c-9bafe90991c5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:07.871277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:07.912017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9eb34-41fe-4a66-93f8-56d893fdc30c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:07.944420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:07.950364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8309f5-e23e-4912-bbca-f18e469519e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:07.951011 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8309f5-e23e-4912-bbca-f18e469519e1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.951284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8309f5-e23e-4912-bbca-f18e469519e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.951557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8309f5-e23e-4912-bbca-f18e469519e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.964475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8309f5-e23e-4912-bbca-f18e469519e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4f8309f5-e23e-4912-bbca-f18e469519e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:07.969906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:07.970920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:07.971844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:07.976122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 294/559] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:07.977079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8309f5-e23e-4912-bbca-f18e469519e1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:07.978098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd6c47-209f-45b4-9e1c-9bafe90991c5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:08.020264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adfcd0-1f70-44cc-a983-3dedd5950d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:08.020872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adfcd0-1f70-44cc-a983-3dedd5950d86 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.021151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adfcd0-1f70-44cc-a983-3dedd5950d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.021421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adfcd0-1f70-44cc-a983-3dedd5950d86 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.022071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adfcd0-1f70-44cc-a983-3dedd5950d86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:08.022371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adfcd0-1f70-44cc-a983-3dedd5950d86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:08.023770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adfcd0-1f70-44cc-a983-3dedd5950d86 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:08.036715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 266/560] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:08.040760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adfcd0-1f70-44cc-a983-3dedd5950d86 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:08.108226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8309f5-e23e-4912-bbca-f18e469519e1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:08.149692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:08.156136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6a14e-4120-4391-9039-73ec02970532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:08.157443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a14e-4120-4391-9039-73ec02970532 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.157870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a14e-4120-4391-9039-73ec02970532 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.158213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6a14e-4120-4391-9039-73ec02970532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.167874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6a14e-4120-4391-9039-73ec02970532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:08.168763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6a14e-4120-4391-9039-73ec02970532 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:08.169230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adfcd0-1f70-44cc-a983-3dedd5950d86 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-34e6a14e-4120-4391-9039-73ec02970532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:08.189201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:08.190415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:08.191501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:08.191501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:08.191501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:08.191501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:08.191501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:08.191501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:08.191501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:08.191501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:08.198586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 295/561] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:08.198586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1572001-0872-49bf-ac64-f132f49912b4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.198586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1572001-0872-49bf-ac64-f132f49912b4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.198586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1572001-0872-49bf-ac64-f132f49912b4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.199283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 296/562] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:08.200050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1572001-0872-49bf-ac64-f132f49912b4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:08.214202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fafc5-d3a2-4393-8395-26d3404d0c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:08.215236 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fafc5-d3a2-4393-8395-26d3404d0c1e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.215774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fafc5-d3a2-4393-8395-26d3404d0c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.216261 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fafc5-d3a2-4393-8395-26d3404d0c1e None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.217496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fafc5-d3a2-4393-8395-26d3404d0c1e None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:08.218058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fafc5-d3a2-4393-8395-26d3404d0c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:08.220813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fafc5-d3a2-4393-8395-26d3404d0c1e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:08.229985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 267/563] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:08.230667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fafc5-d3a2-4393-8395-26d3404d0c1e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:08.279907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:08.349428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1572001-0872-49bf-ac64-f132f49912b4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:08.367406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fafc5-d3a2-4393-8395-26d3404d0c1e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:08.393701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2bb69-2e8a-48d8-a635-0388003f6343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:08.394344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2bb69-2e8a-48d8-a635-0388003f6343 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.394621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2bb69-2e8a-48d8-a635-0388003f6343 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.394892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2bb69-2e8a-48d8-a635-0388003f6343 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.403802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2bb69-2e8a-48d8-a635-0388003f6343 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:08.405294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2bb69-2e8a-48d8-a635-0388003f6343 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:08.412165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df53643-5abf-412f-b7a6-19130dfe8c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:08.412788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53643-5abf-412f-b7a6-19130dfe8c40 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.413047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53643-5abf-412f-b7a6-19130dfe8c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.413371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53643-5abf-412f-b7a6-19130dfe8c40 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.414621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df53643-5abf-412f-b7a6-19130dfe8c40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:08.415183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df53643-5abf-412f-b7a6-19130dfe8c40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:08.417940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df53643-5abf-412f-b7a6-19130dfe8c40 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-48e2bb69-2e8a-48d8-a635-0388003f6343 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:08.418620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:08.420358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:08.422595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:08.424733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 297/564] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:08.426263 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25938-6db5-4332-9082-fece2b38565d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.426544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25938-6db5-4332-9082-fece2b38565d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.426821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25938-6db5-4332-9082-fece2b38565d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.428271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 298/565] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:08.429584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44167d9-33d1-4bc3-abcd-b2363920ec10 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.429863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44167d9-33d1-4bc3-abcd-b2363920ec10 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.430205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44167d9-33d1-4bc3-abcd-b2363920ec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.434110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 268/566] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:08.435004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df53643-5abf-412f-b7a6-19130dfe8c40 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:08.450181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:08.457867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b44167d9-33d1-4bc3-abcd-b2363920ec10 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:08.459130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b44167d9-33d1-4bc3-abcd-b2363920ec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:08.538211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 299/567] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:08.539303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44167d9-33d1-4bc3-abcd-b2363920ec10 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:08.568920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df53643-5abf-412f-b7a6-19130dfe8c40 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:08.607859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:08.617180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d69d7-55b9-4a86-a801-a5beebf74f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:08.617821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d69d7-55b9-4a86-a801-a5beebf74f96 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.623405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d69d7-55b9-4a86-a801-a5beebf74f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.623405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d69d7-55b9-4a86-a801-a5beebf74f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.634750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d69d7-55b9-4a86-a801-a5beebf74f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:08.636236 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d69d7-55b9-4a86-a801-a5beebf74f96 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-939d69d7-55b9-4a86-a801-a5beebf74f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:08.658930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:08.661586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:08.662495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:08.662495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:08.662495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:08.668057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 269/568] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:08.669647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42038-44ca-4c8c-adb3-c68e9c6c0aec None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.669928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42038-44ca-4c8c-adb3-c68e9c6c0aec None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.670202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42038-44ca-4c8c-adb3-c68e9c6c0aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.693544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6cf42038-44ca-4c8c-adb3-c68e9c6c0aec None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:08.694764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6cf42038-44ca-4c8c-adb3-c68e9c6c0aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:08.699444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44167d9-33d1-4bc3-abcd-b2363920ec10 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:08.772138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbf2e8-cc89-49a4-904b-ebdeae3eac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:08.772754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbf2e8-cc89-49a4-904b-ebdeae3eac52 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.773149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbf2e8-cc89-49a4-904b-ebdeae3eac52 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.773378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbf2e8-cc89-49a4-904b-ebdeae3eac52 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.774046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbf2e8-cc89-49a4-904b-ebdeae3eac52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:08.774348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbf2e8-cc89-49a4-904b-ebdeae3eac52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:08.774772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:08.775834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbf2e8-cc89-49a4-904b-ebdeae3eac52 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:08.800488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 270/569] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:08.800488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42038-44ca-4c8c-adb3-c68e9c6c0aec None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:08.801363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 300/570] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Aug 31 10:59:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:08.805179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbf2e8-cc89-49a4-904b-ebdeae3eac52 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:08.931666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:08.935783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbf2e8-cc89-49a4-904b-ebdeae3eac52 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:08.939591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42038-44ca-4c8c-adb3-c68e9c6c0aec None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:08.992303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118412-c906-4bcf-b87e-f62661f432b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:08.992690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ee4c-dfc4-4121-a99c-6c5f7d5d2fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:08.992902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118412-c906-4bcf-b87e-f62661f432b5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.993179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118412-c906-4bcf-b87e-f62661f432b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.993446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118412-c906-4bcf-b87e-f62661f432b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.993678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ee4c-dfc4-4121-a99c-6c5f7d5d2fc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:08.994107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118412-c906-4bcf-b87e-f62661f432b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:08.994255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ee4c-dfc4-4121-a99c-6c5f7d5d2fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:08.994383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118412-c906-4bcf-b87e-f62661f432b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:08.994645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ee4c-dfc4-4121-a99c-6c5f7d5d2fc7 None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/c9c5d8bbcf07486ea3d3e26c81135d2f/roles/ea287c8c7f9442cf99fb462bb85b39b2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:08.995779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7118412-c906-4bcf-b87e-f62661f432b5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.016664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 301/571] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:09.016664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118412-c906-4bcf-b87e-f62661f432b5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.031918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703ee4c-dfc4-4121-a99c-6c5f7d5d2fc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=c9c5d8bbcf07486ea3d3e26c81135d2f, role_id=ea287c8c7f9442cf99fb462bb85b39b2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:09.031918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703ee4c-dfc4-4121-a99c-6c5f7d5d2fc7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.135804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 271/572] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:59:08 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/c9c5d8bbcf07486ea3d3e26c81135d2f/roles/ea287c8c7f9442cf99fb462bb85b39b2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:09.137027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ee4c-dfc4-4121-a99c-6c5f7d5d2fc7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.151232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7118412-c906-4bcf-b87e-f62661f432b5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.192630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:09.210545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b593bb-8d71-4374-be51-adb955eea1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.211642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b593bb-8d71-4374-be51-adb955eea1ba None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.212047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b593bb-8d71-4374-be51-adb955eea1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.212431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b593bb-8d71-4374-be51-adb955eea1ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.260113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:09.285925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ee4c-dfc4-4121-a99c-6c5f7d5d2fc7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.317002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b593bb-8d71-4374-be51-adb955eea1ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:09.319104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b593bb-8d71-4374-be51-adb955eea1ba None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.335188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cde80-ed96-4f61-9114-7344005865b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.335915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cde80-ed96-4f61-9114-7344005865b1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.336523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cde80-ed96-4f61-9114-7344005865b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.336804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cde80-ed96-4f61-9114-7344005865b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.348814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cde80-ed96-4f61-9114-7344005865b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-fc1cde80-ed96-4f61-9114-7344005865b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:09.353722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:09.354780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:09.355813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 272/573] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:09.356730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cde80-ed96-4f61-9114-7344005865b1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.462190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 302/574] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:09.462190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b593bb-8d71-4374-be51-adb955eea1ba None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.499402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:09.504841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cde80-ed96-4f61-9114-7344005865b1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.532126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:09.549782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0b274-b847-4f59-ba3e-f933b86dcc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.550429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0b274-b847-4f59-ba3e-f933b86dcc9f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.550712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0b274-b847-4f59-ba3e-f933b86dcc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.550986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0b274-b847-4f59-ba3e-f933b86dcc9f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.560364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0b274-b847-4f59-ba3e-f933b86dcc9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:09.561848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0b274-b847-4f59-ba3e-f933b86dcc9f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-12a0b274-b847-4f59-ba3e-f933b86dcc9f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:09.575255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:09.576296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 273/575] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:09.577474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0b274-b847-4f59-ba3e-f933b86dcc9f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.585530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b593bb-8d71-4374-be51-adb955eea1ba None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.623735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce91a8-7d24-4942-aa23-e258a4cb497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.624564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce91a8-7d24-4942-aa23-e258a4cb497d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.624722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce91a8-7d24-4942-aa23-e258a4cb497d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.625054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce91a8-7d24-4942-aa23-e258a4cb497d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.637328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce91a8-7d24-4942-aa23-e258a4cb497d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-07ce91a8-7d24-4942-aa23-e258a4cb497d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:09.643049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:09.644675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 303/576] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:09.645604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce91a8-7d24-4942-aa23-e258a4cb497d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.706947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0b274-b847-4f59-ba3e-f933b86dcc9f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.745139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7785c74-8d68-4d7a-9c43-3d64ddc4b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.745783 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7785c74-8d68-4d7a-9c43-3d64ddc4b984 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.746062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7785c74-8d68-4d7a-9c43-3d64ddc4b984 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.746454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7785c74-8d68-4d7a-9c43-3d64ddc4b984 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.747123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7785c74-8d68-4d7a-9c43-3d64ddc4b984 None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:09.747425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7785c74-8d68-4d7a-9c43-3d64ddc4b984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:09.748957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7785c74-8d68-4d7a-9c43-3d64ddc4b984 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.755677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce91a8-7d24-4942-aa23-e258a4cb497d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.758562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 274/577] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:09.759412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7785c74-8d68-4d7a-9c43-3d64ddc4b984 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.785104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:09.785744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:09.805282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fddb28-db16-42ac-8ecc-1a43d6efda9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.806075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fddb28-db16-42ac-8ecc-1a43d6efda9c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.806358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fddb28-db16-42ac-8ecc-1a43d6efda9c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.806632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fddb28-db16-42ac-8ecc-1a43d6efda9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.817557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fddb28-db16-42ac-8ecc-1a43d6efda9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:09.819290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fddb28-db16-42ac-8ecc-1a43d6efda9c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f3fddb28-db16-42ac-8ecc-1a43d6efda9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:09.837077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:09.838090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:09.838999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:09.838999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:09.838999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:09.838999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 304/578] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:09.838999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fddb28-db16-42ac-8ecc-1a43d6efda9c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.897185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7785c74-8d68-4d7a-9c43-3d64ddc4b984 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.937047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db632a7-2a40-4ff6-8832-7bcf760551bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.938521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db632a7-2a40-4ff6-8832-7bcf760551bb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.938651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db632a7-2a40-4ff6-8832-7bcf760551bb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.938848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db632a7-2a40-4ff6-8832-7bcf760551bb None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.939782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db632a7-2a40-4ff6-8832-7bcf760551bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:09.940098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db632a7-2a40-4ff6-8832-7bcf760551bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:09.941546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db632a7-2a40-4ff6-8832-7bcf760551bb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.954961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fddb28-db16-42ac-8ecc-1a43d6efda9c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.960448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 275/579] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:09.965169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db632a7-2a40-4ff6-8832-7bcf760551bb None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.997125 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36430e4b-942a-470e-9c0b-45568d7a1ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.997676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36430e4b-942a-470e-9c0b-45568d7a1ddd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.997956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36430e4b-942a-470e-9c0b-45568d7a1ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.998218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36430e4b-942a-470e-9c0b-45568d7a1ddd None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.998858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36430e4b-942a-470e-9c0b-45568d7a1ddd None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:09.999164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36430e4b-942a-470e-9c0b-45568d7a1ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.000940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36430e4b-942a-470e-9c0b-45568d7a1ddd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.014941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 305/580] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:10.014941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36430e4b-942a-470e-9c0b-45568d7a1ddd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.055862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.058937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.081318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db632a7-2a40-4ff6-8832-7bcf760551bb None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.119763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7266976-d28a-4c02-a3ad-7137112dbfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.120495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7266976-d28a-4c02-a3ad-7137112dbfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.120844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7266976-d28a-4c02-a3ad-7137112dbfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.121175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7266976-d28a-4c02-a3ad-7137112dbfc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.131834 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7266976-d28a-4c02-a3ad-7137112dbfc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.133294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7266976-d28a-4c02-a3ad-7137112dbfc3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.134929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36430e4b-942a-470e-9c0b-45568d7a1ddd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-c7266976-d28a-4c02-a3ad-7137112dbfc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:10.153543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:10.155541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:10.157799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:10.157799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:10.157799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:10.157799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 276/581] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:10.157799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7266976-d28a-4c02-a3ad-7137112dbfc3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.198733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e991b1-b97d-457c-8f32-54dc6060a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.199980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e991b1-b97d-457c-8f32-54dc6060a53e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.200282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e991b1-b97d-457c-8f32-54dc6060a53e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.200562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e991b1-b97d-457c-8f32-54dc6060a53e None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.201209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e991b1-b97d-457c-8f32-54dc6060a53e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:10.201505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e991b1-b97d-457c-8f32-54dc6060a53e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.202876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e991b1-b97d-457c-8f32-54dc6060a53e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.225297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 306/582] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:10.225297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e991b1-b97d-457c-8f32-54dc6060a53e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.304249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7266976-d28a-4c02-a3ad-7137112dbfc3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.338526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.345582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241de9f0-78ca-48ee-8136-f2215d29f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.346240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241de9f0-78ca-48ee-8136-f2215d29f163 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.352292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241de9f0-78ca-48ee-8136-f2215d29f163 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.352292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241de9f0-78ca-48ee-8136-f2215d29f163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.358190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.358339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241de9f0-78ca-48ee-8136-f2215d29f163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.359772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241de9f0-78ca-48ee-8136-f2215d29f163 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-241de9f0-78ca-48ee-8136-f2215d29f163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:10.376316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:10.377336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:10.378222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:10.378222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:10.378222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:10.378222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 277/583] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:10.378915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241de9f0-78ca-48ee-8136-f2215d29f163 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.386711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e991b1-b97d-457c-8f32-54dc6060a53e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.430654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92df45-e50c-4c9b-8739-768462932028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.431417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92df45-e50c-4c9b-8739-768462932028 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.431801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92df45-e50c-4c9b-8739-768462932028 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.432092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92df45-e50c-4c9b-8739-768462932028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.443822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92df45-e50c-4c9b-8739-768462932028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.445310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92df45-e50c-4c9b-8739-768462932028 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-df92df45-e50c-4c9b-8739-768462932028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:10.461481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:10.463167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:10.464768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:10.464768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:10.464768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:10.467484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 307/584] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:10.468256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92df45-e50c-4c9b-8739-768462932028 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.535660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241de9f0-78ca-48ee-8136-f2215d29f163 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.580604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1bc7b-d3fd-448a-9d0e-0d721568e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.581219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1bc7b-d3fd-448a-9d0e-0d721568e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.581497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1bc7b-d3fd-448a-9d0e-0d721568e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.581767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1bc7b-d3fd-448a-9d0e-0d721568e1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.582500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1bc7b-d3fd-448a-9d0e-0d721568e1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:10.582716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1bc7b-d3fd-448a-9d0e-0d721568e1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.584133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1bc7b-d3fd-448a-9d0e-0d721568e1d9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.603791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 278/585] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:10.603791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1bc7b-d3fd-448a-9d0e-0d721568e1d9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.604159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92df45-e50c-4c9b-8739-768462932028 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.643679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa1931-180c-4851-86f8-464b88fcc077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.644351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa1931-180c-4851-86f8-464b88fcc077 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.644630 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa1931-180c-4851-86f8-464b88fcc077 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.644907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa1931-180c-4851-86f8-464b88fcc077 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.652316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa1931-180c-4851-86f8-464b88fcc077 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.653770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa1931-180c-4851-86f8-464b88fcc077 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.665656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7cfa1931-180c-4851-86f8-464b88fcc077 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:10.666778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:10.667643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:10.668594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:10.668594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:10.668594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:10.668594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:10.668594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:10.668594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:10.668594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:10.668594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:10.668594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 308/586] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:10.669079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa1931-180c-4851-86f8-464b88fcc077 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.684735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.735663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1bc7b-d3fd-448a-9d0e-0d721568e1d9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.772339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ed353-28ba-45c2-85c7-ee82ec86819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.772963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ed353-28ba-45c2-85c7-ee82ec86819e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.773352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ed353-28ba-45c2-85c7-ee82ec86819e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.773617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ed353-28ba-45c2-85c7-ee82ec86819e None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.774231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ed353-28ba-45c2-85c7-ee82ec86819e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:10.774533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ed353-28ba-45c2-85c7-ee82ec86819e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.775957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ed353-28ba-45c2-85c7-ee82ec86819e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.789701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 279/587] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:10.790300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa1931-180c-4851-86f8-464b88fcc077 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.790532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ed353-28ba-45c2-85c7-ee82ec86819e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.830301 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de720917-6cf8-4da5-9a3e-c8dc04e29be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.830904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720917-6cf8-4da5-9a3e-c8dc04e29be7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.831176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720917-6cf8-4da5-9a3e-c8dc04e29be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.831449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720917-6cf8-4da5-9a3e-c8dc04e29be7 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.832131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de720917-6cf8-4da5-9a3e-c8dc04e29be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:10.832431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de720917-6cf8-4da5-9a3e-c8dc04e29be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.833839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de720917-6cf8-4da5-9a3e-c8dc04e29be7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.847778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 309/588] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:10.848539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de720917-6cf8-4da5-9a3e-c8dc04e29be7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.922632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ed353-28ba-45c2-85c7-ee82ec86819e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.924408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.930473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.969975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27304b69-4973-404b-bcdf-0abfac70c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.970938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27304b69-4973-404b-bcdf-0abfac70c105 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.971392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27304b69-4973-404b-bcdf-0abfac70c105 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.971872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27304b69-4973-404b-bcdf-0abfac70c105 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.982210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de720917-6cf8-4da5-9a3e-c8dc04e29be7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.985391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27304b69-4973-404b-bcdf-0abfac70c105 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.987434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27304b69-4973-404b-bcdf-0abfac70c105 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-27304b69-4973-404b-bcdf-0abfac70c105 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:11.008250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:11.009354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:11.010262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 280/589] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:11.011586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27304b69-4973-404b-bcdf-0abfac70c105 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.037448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04901ffd-52b1-43bf-b716-344ddfe9121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.038218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04901ffd-52b1-43bf-b716-344ddfe9121a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.038580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04901ffd-52b1-43bf-b716-344ddfe9121a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.038857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04901ffd-52b1-43bf-b716-344ddfe9121a None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.039559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04901ffd-52b1-43bf-b716-344ddfe9121a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:11.039946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04901ffd-52b1-43bf-b716-344ddfe9121a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.041362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04901ffd-52b1-43bf-b716-344ddfe9121a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.054538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 310/590] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:11.055730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04901ffd-52b1-43bf-b716-344ddfe9121a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.144460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27304b69-4973-404b-bcdf-0abfac70c105 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.173156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04901ffd-52b1-43bf-b716-344ddfe9121a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.188919 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44534257-2e99-498a-9a11-6616f4ff2f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.189936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534257-2e99-498a-9a11-6616f4ff2f8a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.190321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534257-2e99-498a-9a11-6616f4ff2f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.190707 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534257-2e99-498a-9a11-6616f4ff2f8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.198265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44534257-2e99-498a-9a11-6616f4ff2f8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.199803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44534257-2e99-498a-9a11-6616f4ff2f8a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.202877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-44534257-2e99-498a-9a11-6616f4ff2f8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:11.212287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:11.213410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:11.214294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:11.214294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:11.214294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:11.214294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:11.214294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:11.214294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:11.214294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:11.214294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:11.214717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb609054-e5e4-4986-86f3-b3854c11d465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.214717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb609054-e5e4-4986-86f3-b3854c11d465 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.214717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb609054-e5e4-4986-86f3-b3854c11d465 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.214717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb609054-e5e4-4986-86f3-b3854c11d465 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.214972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 281/591] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:11.214972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44534257-2e99-498a-9a11-6616f4ff2f8a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.227183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb609054-e5e4-4986-86f3-b3854c11d465 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.228680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb609054-e5e4-4986-86f3-b3854c11d465 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-cb609054-e5e4-4986-86f3-b3854c11d465 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:11.243106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:11.252192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 311/592] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:11.254017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb609054-e5e4-4986-86f3-b3854c11d465 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.257278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.339457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44534257-2e99-498a-9a11-6616f4ff2f8a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.357239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb609054-e5e4-4986-86f3-b3854c11d465 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.391876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f40997-c888-4635-9228-7d3c7c1f53ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.392498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f40997-c888-4635-9228-7d3c7c1f53ed None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.392774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f40997-c888-4635-9228-7d3c7c1f53ed None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.393052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f40997-c888-4635-9228-7d3c7c1f53ed None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.393785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f40997-c888-4635-9228-7d3c7c1f53ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:11.394084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f40997-c888-4635-9228-7d3c7c1f53ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.395526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17080ca6-5366-43a5-9b76-de423b2d9625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.395667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f40997-c888-4635-9228-7d3c7c1f53ed None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.396171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17080ca6-5366-43a5-9b76-de423b2d9625 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.396446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17080ca6-5366-43a5-9b76-de423b2d9625 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.396714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17080ca6-5366-43a5-9b76-de423b2d9625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.397438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17080ca6-5366-43a5-9b76-de423b2d9625 None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=62c91e3eec414a5189befb91012955c2) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:11.397741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17080ca6-5366-43a5-9b76-de423b2d9625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.399176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17080ca6-5366-43a5-9b76-de423b2d9625 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.408003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 312/593] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/role_assignments?user.id=62c91e3eec414a5189befb91012955c2&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:11.408003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66482703-d40d-4f85-a984-d5690275160d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.408003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66482703-d40d-4f85-a984-d5690275160d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.408003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66482703-d40d-4f85-a984-d5690275160d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.411880 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 313/594] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:11.411880 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66482703-d40d-4f85-a984-d5690275160d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.424989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 282/595] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:11.425888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f40997-c888-4635-9228-7d3c7c1f53ed None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.479987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.536736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.546647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66482703-d40d-4f85-a984-d5690275160d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.559899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f40997-c888-4635-9228-7d3c7c1f53ed None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.584939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717945c-1b23-4448-bbe6-8ef1b4906c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.585550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717945c-1b23-4448-bbe6-8ef1b4906c4f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.585824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717945c-1b23-4448-bbe6-8ef1b4906c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.586092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717945c-1b23-4448-bbe6-8ef1b4906c4f None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.586795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717945c-1b23-4448-bbe6-8ef1b4906c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:11.587096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717945c-1b23-4448-bbe6-8ef1b4906c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.588559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717945c-1b23-4448-bbe6-8ef1b4906c4f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.598644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf38596-dc2c-454e-bd7f-cc6d7bdd72c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.599332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf38596-dc2c-454e-bd7f-cc6d7bdd72c2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.599709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf38596-dc2c-454e-bd7f-cc6d7bdd72c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.600120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf38596-dc2c-454e-bd7f-cc6d7bdd72c2 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.600967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf38596-dc2c-454e-bd7f-cc6d7bdd72c2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:11.601376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf38596-dc2c-454e-bd7f-cc6d7bdd72c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.602927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf38596-dc2c-454e-bd7f-cc6d7bdd72c2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.606790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 314/596] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:11.608194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d76c5-3a62-4e5e-b12b-545467f0fe08 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.608484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d76c5-3a62-4e5e-b12b-545467f0fe08 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.608761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d76c5-3a62-4e5e-b12b-545467f0fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.628179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 283/597] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:11.628179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf38596-dc2c-454e-bd7f-cc6d7bdd72c2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.629578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d73d76c5-3a62-4e5e-b12b-545467f0fe08 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:11.630931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d73d76c5-3a62-4e5e-b12b-545467f0fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:11.711659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 315/598] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:11.723183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d76c5-3a62-4e5e-b12b-545467f0fe08 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.760652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf38596-dc2c-454e-bd7f-cc6d7bdd72c2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.788362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.819163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31430af2-54b3-45a3-851c-b35df74d24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.821253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31430af2-54b3-45a3-851c-b35df74d24ef None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.821888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31430af2-54b3-45a3-851c-b35df74d24ef None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.822573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31430af2-54b3-45a3-851c-b35df74d24ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.833500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.838412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31430af2-54b3-45a3-851c-b35df74d24ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.840160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31430af2-54b3-45a3-851c-b35df74d24ef None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-31430af2-54b3-45a3-851c-b35df74d24ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:11.857806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:11.858890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:11.860078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:11.860078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:11.860078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:11.860078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 284/599] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:11.865365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31430af2-54b3-45a3-851c-b35df74d24ef None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.871343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d76c5-3a62-4e5e-b12b-545467f0fe08 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.919124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19908143-22e6-4e45-9d54-84217522587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.920288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19908143-22e6-4e45-9d54-84217522587c None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.920677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19908143-22e6-4e45-9d54-84217522587c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.921063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19908143-22e6-4e45-9d54-84217522587c None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/a8855e3e7fc84cd9ba1afaef4cc308c5/roles/ea287c8c7f9442cf99fb462bb85b39b2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.944731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19908143-22e6-4e45-9d54-84217522587c None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=a8855e3e7fc84cd9ba1afaef4cc308c5, role_id=ea287c8c7f9442cf99fb462bb85b39b2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.947353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19908143-22e6-4e45-9d54-84217522587c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.980924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31430af2-54b3-45a3-851c-b35df74d24ef None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.026149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262508-1dc0-4a4b-af4c-f6585460b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.026780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262508-1dc0-4a4b-af4c-f6585460b5ef None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.027098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262508-1dc0-4a4b-af4c-f6585460b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.027338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262508-1dc0-4a4b-af4c-f6585460b5ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.038903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54262508-1dc0-4a4b-af4c-f6585460b5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.040430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54262508-1dc0-4a4b-af4c-f6585460b5ef None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.045003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 316/600] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:59:11 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/a8855e3e7fc84cd9ba1afaef4cc308c5/roles/ea287c8c7f9442cf99fb462bb85b39b2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:12.046065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19908143-22e6-4e45-9d54-84217522587c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-54262508-1dc0-4a4b-af4c-f6585460b5ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:12.064446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:12.065702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:12.066860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:12.066860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:12.066860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:12.072225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 285/601] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:12.073415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262508-1dc0-4a4b-af4c-f6585460b5ef None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.155115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.188058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.201507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19908143-22e6-4e45-9d54-84217522587c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.244661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262508-1dc0-4a4b-af4c-f6585460b5ef None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.278800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70977eaa-1ead-4d97-8501-a440ba90251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.280120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70977eaa-1ead-4d97-8501-a440ba90251f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.280547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70977eaa-1ead-4d97-8501-a440ba90251f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.280983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70977eaa-1ead-4d97-8501-a440ba90251f None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.283407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70977eaa-1ead-4d97-8501-a440ba90251f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:12.283908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70977eaa-1ead-4d97-8501-a440ba90251f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.285466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70977eaa-1ead-4d97-8501-a440ba90251f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.303824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 317/602] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:12.304958 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70977eaa-1ead-4d97-8501-a440ba90251f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.313718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef512c-7b21-4022-9018-bcfe23db6ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.314587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef512c-7b21-4022-9018-bcfe23db6ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.314942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef512c-7b21-4022-9018-bcfe23db6ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.315287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef512c-7b21-4022-9018-bcfe23db6ef8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.330743 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef512c-7b21-4022-9018-bcfe23db6ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-64ef512c-7b21-4022-9018-bcfe23db6ef8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:12.337695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:12.338878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:12.339989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:12.341445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 286/603] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:12.346629 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef512c-7b21-4022-9018-bcfe23db6ef8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.450649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70977eaa-1ead-4d97-8501-a440ba90251f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.480785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef512c-7b21-4022-9018-bcfe23db6ef8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.482501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.492821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a165ac-78bf-48c3-ae46-e1a410b70c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.493688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a165ac-78bf-48c3-ae46-e1a410b70c45 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.502031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a165ac-78bf-48c3-ae46-e1a410b70c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.502031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a165ac-78bf-48c3-ae46-e1a410b70c45 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.502031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a165ac-78bf-48c3-ae46-e1a410b70c45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:12.502031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a165ac-78bf-48c3-ae46-e1a410b70c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.502031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a165ac-78bf-48c3-ae46-e1a410b70c45 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.511218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 318/604] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:12.512377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a165ac-78bf-48c3-ae46-e1a410b70c45 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.526413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.541011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e43860-ee9d-428f-8c4c-282ffa03616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.542187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e43860-ee9d-428f-8c4c-282ffa03616a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.542812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e43860-ee9d-428f-8c4c-282ffa03616a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.543214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e43860-ee9d-428f-8c4c-282ffa03616a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.557066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e43860-ee9d-428f-8c4c-282ffa03616a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.559734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e43860-ee9d-428f-8c4c-282ffa03616a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f0e43860-ee9d-428f-8c4c-282ffa03616a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:12.580337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:12.581526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:12.582621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:12.582621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:12.582621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:12.582621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:12.582621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:12.582621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:12.582621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:12.582621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:12.588065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 287/605] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:12.589015 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e43860-ee9d-428f-8c4c-282ffa03616a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.642509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a165ac-78bf-48c3-ae46-e1a410b70c45 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.682059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50a8f6-c928-496b-a1bb-b993b34a0ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.683055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50a8f6-c928-496b-a1bb-b993b34a0ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.683528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50a8f6-c928-496b-a1bb-b993b34a0ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.683976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50a8f6-c928-496b-a1bb-b993b34a0ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.684823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50a8f6-c928-496b-a1bb-b993b34a0ca7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:12.685261 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50a8f6-c928-496b-a1bb-b993b34a0ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.686854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50a8f6-c928-496b-a1bb-b993b34a0ca7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.696537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 319/606] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:12.697586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50a8f6-c928-496b-a1bb-b993b34a0ca7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.714500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e43860-ee9d-428f-8c4c-282ffa03616a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.761584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f4f8c-f366-48a0-b99b-43a1a63405ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.762268 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f4f8c-f366-48a0-b99b-43a1a63405ee None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.762628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f4f8c-f366-48a0-b99b-43a1a63405ee None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.762960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f4f8c-f366-48a0-b99b-43a1a63405ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.770935 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f4f8c-f366-48a0-b99b-43a1a63405ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.772524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f4f8c-f366-48a0-b99b-43a1a63405ee None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.778841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e36f4f8c-f366-48a0-b99b-43a1a63405ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:12.786548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:12.787692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:12.788776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:12.788776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:12.788776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:12.788776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:12.788776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:12.788776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:12.788776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:12.788776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:12.795761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 288/607] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:12.796780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f4f8c-f366-48a0-b99b-43a1a63405ee None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.819350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50a8f6-c928-496b-a1bb-b993b34a0ca7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.824964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.858869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7542b4-9cbe-401d-993c-7c6515c7a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.859895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7542b4-9cbe-401d-993c-7c6515c7a720 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.860432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7542b4-9cbe-401d-993c-7c6515c7a720 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.860875 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7542b4-9cbe-401d-993c-7c6515c7a720 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.861742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7542b4-9cbe-401d-993c-7c6515c7a720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:12.862209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7542b4-9cbe-401d-993c-7c6515c7a720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.863890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7542b4-9cbe-401d-993c-7c6515c7a720 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.882754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 320/608] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:12.884209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7542b4-9cbe-401d-993c-7c6515c7a720 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.915022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f4f8c-f366-48a0-b99b-43a1a63405ee None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.952885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c6a15-124d-40f7-8174-9a29313fe2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.954519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c6a15-124d-40f7-8174-9a29313fe2cc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.954519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c6a15-124d-40f7-8174-9a29313fe2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.954923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c6a15-124d-40f7-8174-9a29313fe2cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.976679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c6a15-124d-40f7-8174-9a29313fe2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.978943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c6a15-124d-40f7-8174-9a29313fe2cc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e28c6a15-124d-40f7-8174-9a29313fe2cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:13.000697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:13.002037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:13.003142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:13.003142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:13.003142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:13.003142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 289/609] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:13.003979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c6a15-124d-40f7-8174-9a29313fe2cc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.006079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7542b4-9cbe-401d-993c-7c6515c7a720 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.057159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:13.063781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e84e7-0448-418e-a4c9-6557c322b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.068281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e84e7-0448-418e-a4c9-6557c322b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.068281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e84e7-0448-418e-a4c9-6557c322b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.068281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e84e7-0448-418e-a4c9-6557c322b0b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.068281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e84e7-0448-418e-a4c9-6557c322b0b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:13.068281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e84e7-0448-418e-a4c9-6557c322b0b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.068281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e84e7-0448-418e-a4c9-6557c322b0b8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.085207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 321/610] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:13.086402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e84e7-0448-418e-a4c9-6557c322b0b8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.133746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:13.164645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c6a15-124d-40f7-8174-9a29313fe2cc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.207608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3aa2e-f9df-4d07-81b3-fd8dcd2fc4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.208715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3aa2e-f9df-4d07-81b3-fd8dcd2fc4c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.209184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3aa2e-f9df-4d07-81b3-fd8dcd2fc4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.209645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3aa2e-f9df-4d07-81b3-fd8dcd2fc4c2 None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/fae0faf062ba4b7a8270fc2ff92a10be/roles/ea287c8c7f9442cf99fb462bb85b39b2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.231244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3aa2e-f9df-4d07-81b3-fd8dcd2fc4c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=fae0faf062ba4b7a8270fc2ff92a10be, role_id=ea287c8c7f9442cf99fb462bb85b39b2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.233491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3aa2e-f9df-4d07-81b3-fd8dcd2fc4c2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.237573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e84e7-0448-418e-a4c9-6557c322b0b8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.282459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcd4c9-44ab-43c1-9a7f-80a9ff6a9be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.283223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcd4c9-44ab-43c1-9a7f-80a9ff6a9be0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.283558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcd4c9-44ab-43c1-9a7f-80a9ff6a9be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.283919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcd4c9-44ab-43c1-9a7f-80a9ff6a9be0 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.284626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcd4c9-44ab-43c1-9a7f-80a9ff6a9be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:13.285064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcd4c9-44ab-43c1-9a7f-80a9ff6a9be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.286561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcd4c9-44ab-43c1-9a7f-80a9ff6a9be0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.306567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 322/611] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:13.307730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcd4c9-44ab-43c1-9a7f-80a9ff6a9be0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.346840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 290/612] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:59:13 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/fae0faf062ba4b7a8270fc2ff92a10be/roles/ea287c8c7f9442cf99fb462bb85b39b2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:13.347934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3aa2e-f9df-4d07-81b3-fd8dcd2fc4c2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.416139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:13.496909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcd4c9-44ab-43c1-9a7f-80a9ff6a9be0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.540834 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3aa2e-f9df-4d07-81b3-fd8dcd2fc4c2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.546913 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5be128-eece-472b-b402-e1ae78fd95da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.548609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5be128-eece-472b-b402-e1ae78fd95da None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.549138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5be128-eece-472b-b402-e1ae78fd95da None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.549631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5be128-eece-472b-b402-e1ae78fd95da None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/041de16601f342c1a9b18003773a0856/roles/ea287c8c7f9442cf99fb462bb85b39b2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.572512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5be128-eece-472b-b402-e1ae78fd95da None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=041de16601f342c1a9b18003773a0856, role_id=ea287c8c7f9442cf99fb462bb85b39b2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.574971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5be128-eece-472b-b402-e1ae78fd95da None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.580681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:13.592682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b749dd-25af-4802-95b6-9be3dbd4fee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.603446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b749dd-25af-4802-95b6-9be3dbd4fee2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.603446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b749dd-25af-4802-95b6-9be3dbd4fee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.603446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b749dd-25af-4802-95b6-9be3dbd4fee2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.603446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b749dd-25af-4802-95b6-9be3dbd4fee2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.603833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b749dd-25af-4802-95b6-9be3dbd4fee2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-95b749dd-25af-4802-95b6-9be3dbd4fee2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:13.617049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:13.618059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 291/613] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Aug 31 10:59:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a92bcc-9308-4d2c-99c5-02420794f1e5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.624199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a92bcc-9308-4d2c-99c5-02420794f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.624942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a92bcc-9308-4d2c-99c5-02420794f1e5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.624942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 292/614] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:13.627200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a92bcc-9308-4d2c-99c5-02420794f1e5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.666902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 323/615] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:59:13 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/041de16601f342c1a9b18003773a0856/roles/ea287c8c7f9442cf99fb462bb85b39b2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:13.673349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dc8ee-bb01-426b-84cb-698c69d7bed4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.673696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dc8ee-bb01-426b-84cb-698c69d7bed4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.673899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dc8ee-bb01-426b-84cb-698c69d7bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.715249 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-424dc8ee-bb01-426b-84cb-698c69d7bed4 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:13.716452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-424dc8ee-bb01-426b-84cb-698c69d7bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.797522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a92bcc-9308-4d2c-99c5-02420794f1e5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.877537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 324/616] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:13.889762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab28a-311f-4bfc-aab6-2f84445bee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.890459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab28a-311f-4bfc-aab6-2f84445bee12 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.890671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab28a-311f-4bfc-aab6-2f84445bee12 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.891152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab28a-311f-4bfc-aab6-2f84445bee12 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.891924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ab28a-311f-4bfc-aab6-2f84445bee12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:13.892225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ab28a-311f-4bfc-aab6-2f84445bee12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.893660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ab28a-311f-4bfc-aab6-2f84445bee12 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.924032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 293/617] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Aug 31 10:59:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:13.929737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dc8ee-bb01-426b-84cb-698c69d7bed4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.981965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.086364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dc8ee-bb01-426b-84cb-698c69d7bed4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.124283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ad091-3db9-4f86-a4f8-6c333bad148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.125019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ad091-3db9-4f86-a4f8-6c333bad148a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.125940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ad091-3db9-4f86-a4f8-6c333bad148a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.126211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ad091-3db9-4f86-a4f8-6c333bad148a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.219653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ad091-3db9-4f86-a4f8-6c333bad148a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.222156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ad091-3db9-4f86-a4f8-6c333bad148a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.269497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab28a-311f-4bfc-aab6-2f84445bee12 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.284133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.333093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.378649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 325/618] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:14.380373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2f5b-2aca-4adc-8868-bdb5634057a9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.380868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2f5b-2aca-4adc-8868-bdb5634057a9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.381340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b2f5b-2aca-4adc-8868-bdb5634057a9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.387485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 326/619] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:14.389838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c12bf-ecc8-4ce5-b5a6-f378bbe67e89 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.390628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c12bf-ecc8-4ce5-b5a6-f378bbe67e89 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.391141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c12bf-ecc8-4ce5-b5a6-f378bbe67e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.415679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab28a-311f-4bfc-aab6-2f84445bee12 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.416478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-069c12bf-ecc8-4ce5-b5a6-f378bbe67e89 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:14.419212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-069c12bf-ecc8-4ce5-b5a6-f378bbe67e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.462269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729f663-44e5-4a5e-ab3a-f2e39b2019c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.462902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729f663-44e5-4a5e-ab3a-f2e39b2019c7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.463176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729f663-44e5-4a5e-ab3a-f2e39b2019c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.463443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729f663-44e5-4a5e-ab3a-f2e39b2019c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.476621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729f663-44e5-4a5e-ab3a-f2e39b2019c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-0729f663-44e5-4a5e-ab3a-f2e39b2019c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:14.483042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:14.485165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 294/620] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:14.491248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729f663-44e5-4a5e-ab3a-f2e39b2019c7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.527232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 327/621] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:59:14.527232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c12bf-ecc8-4ce5-b5a6-f378bbe67e89 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.638115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729f663-44e5-4a5e-ab3a-f2e39b2019c7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.648479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.665313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.709756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c12bf-ecc8-4ce5-b5a6-f378bbe67e89 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.726880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7b3cc-bf76-4162-bcfd-38a198d631e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.727882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7b3cc-bf76-4162-bcfd-38a198d631e5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.728318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7b3cc-bf76-4162-bcfd-38a198d631e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.728744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7b3cc-bf76-4162-bcfd-38a198d631e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.750428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7b3cc-bf76-4162-bcfd-38a198d631e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.753504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7b3cc-bf76-4162-bcfd-38a198d631e5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-83f7b3cc-bf76-4162-bcfd-38a198d631e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:14.786037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:14.787121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:14.787121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:14.787121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:14.793035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 295/622] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:14.794276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e11eaf-aabe-46b5-8473-ced01aedf127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.795503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e11eaf-aabe-46b5-8473-ced01aedf127 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.796189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e11eaf-aabe-46b5-8473-ced01aedf127 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.796829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e11eaf-aabe-46b5-8473-ced01aedf127 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.798675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e11eaf-aabe-46b5-8473-ced01aedf127 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:14.799181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e11eaf-aabe-46b5-8473-ced01aedf127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.800761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e11eaf-aabe-46b5-8473-ced01aedf127 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.801824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7b3cc-bf76-4162-bcfd-38a198d631e5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.822179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 328/623] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:14.829645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e11eaf-aabe-46b5-8473-ced01aedf127 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.930864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7b3cc-bf76-4162-bcfd-38a198d631e5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.963914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e11eaf-aabe-46b5-8473-ced01aedf127 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.975446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9807d6-8a9e-4106-966b-75fb45a15a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.976433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9807d6-8a9e-4106-966b-75fb45a15a42 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.976597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9807d6-8a9e-4106-966b-75fb45a15a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.976973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9807d6-8a9e-4106-966b-75fb45a15a42 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.977733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9807d6-8a9e-4106-966b-75fb45a15a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:14.978256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9807d6-8a9e-4106-966b-75fb45a15a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.979721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9807d6-8a9e-4106-966b-75fb45a15a42 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.992116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.994546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 296/624] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:14.995668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9807d6-8a9e-4106-966b-75fb45a15a42 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.005001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4b55-4c64-4bb9-8667-53e8e449645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.006390 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4b55-4c64-4bb9-8667-53e8e449645a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.006828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4b55-4c64-4bb9-8667-53e8e449645a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.007248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b4b55-4c64-4bb9-8667-53e8e449645a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.014588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.021205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4b55-4c64-4bb9-8667-53e8e449645a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.022903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b4b55-4c64-4bb9-8667-53e8e449645a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a38b4b55-4c64-4bb9-8667-53e8e449645a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:15.039360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:15.040561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:15.041608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:15.041608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:15.041608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:15.043466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 329/625] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:15.044492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4b55-4c64-4bb9-8667-53e8e449645a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.126887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9807d6-8a9e-4106-966b-75fb45a15a42 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.157598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b4b55-4c64-4bb9-8667-53e8e449645a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.167866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a6a3-a64e-433d-8747-602c41f4a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.168748 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a6a3-a64e-433d-8747-602c41f4a247 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.169131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a6a3-a64e-433d-8747-602c41f4a247 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.169505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a6a3-a64e-433d-8747-602c41f4a247 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.182362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9a6a3-a64e-433d-8747-602c41f4a247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-56b9a6a3-a64e-433d-8747-602c41f4a247 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:15.189007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:15.190029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:15.192582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 297/626] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:15.193198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a6a3-a64e-433d-8747-602c41f4a247 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.207723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baa14d-5acd-4c66-9378-d1da804ac392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.208438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa14d-5acd-4c66-9378-d1da804ac392 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.208837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa14d-5acd-4c66-9378-d1da804ac392 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.209120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa14d-5acd-4c66-9378-d1da804ac392 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.222956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58baa14d-5acd-4c66-9378-d1da804ac392 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.225005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58baa14d-5acd-4c66-9378-d1da804ac392 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-58baa14d-5acd-4c66-9378-d1da804ac392 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:15.240745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:15.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:15.242741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:15.242741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:15.242741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:15.242741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:15.242741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:15.242741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:15.242741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:15.242741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:15.242741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 330/627] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:15.243340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baa14d-5acd-4c66-9378-d1da804ac392 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.292700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.308363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.321130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a6a3-a64e-433d-8747-602c41f4a247 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.360167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f998e2e-4606-452f-9ecf-1b6ea99a9136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.360962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998e2e-4606-452f-9ecf-1b6ea99a9136 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.361389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998e2e-4606-452f-9ecf-1b6ea99a9136 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.361766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f998e2e-4606-452f-9ecf-1b6ea99a9136 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.362748 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f998e2e-4606-452f-9ecf-1b6ea99a9136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:15.362980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f998e2e-4606-452f-9ecf-1b6ea99a9136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.364537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f998e2e-4606-452f-9ecf-1b6ea99a9136 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.376858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baa14d-5acd-4c66-9378-d1da804ac392 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.377957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 298/628] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:15.383188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f998e2e-4606-452f-9ecf-1b6ea99a9136 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.416584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be7d5-c0c6-414b-8a6b-fd7b3c8edf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.417537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be7d5-c0c6-414b-8a6b-fd7b3c8edf7f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.417955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be7d5-c0c6-414b-8a6b-fd7b3c8edf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.418365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901be7d5-c0c6-414b-8a6b-fd7b3c8edf7f None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.419169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901be7d5-c0c6-414b-8a6b-fd7b3c8edf7f None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:15.419637 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901be7d5-c0c6-414b-8a6b-fd7b3c8edf7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.421386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901be7d5-c0c6-414b-8a6b-fd7b3c8edf7f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.431573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 331/629] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:15.432795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be7d5-c0c6-414b-8a6b-fd7b3c8edf7f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.495881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f998e2e-4606-452f-9ecf-1b6ea99a9136 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.534124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faba791-71db-4c29-91ee-63a8cce2fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.534953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faba791-71db-4c29-91ee-63a8cce2fa75 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.535344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faba791-71db-4c29-91ee-63a8cce2fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.535770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faba791-71db-4c29-91ee-63a8cce2fa75 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.536616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faba791-71db-4c29-91ee-63a8cce2fa75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:15.537037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faba791-71db-4c29-91ee-63a8cce2fa75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.538623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faba791-71db-4c29-91ee-63a8cce2fa75 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.540575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.549516 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.558729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 299/630] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:15.558729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faba791-71db-4c29-91ee-63a8cce2fa75 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.559228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901be7d5-c0c6-414b-8a6b-fd7b3c8edf7f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.597761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4b6b5-a3d4-4757-9f43-6c8e4971655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.598818 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4b6b5-a3d4-4757-9f43-6c8e4971655b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.599281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4b6b5-a3d4-4757-9f43-6c8e4971655b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.599728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4b6b5-a3d4-4757-9f43-6c8e4971655b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.608426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4b6b5-a3d4-4757-9f43-6c8e4971655b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.610751 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4b6b5-a3d4-4757-9f43-6c8e4971655b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4db4b6b5-a3d4-4757-9f43-6c8e4971655b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:15.624074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:15.625726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:15.626976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:15.630736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 332/631] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:15.631962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4b6b5-a3d4-4757-9f43-6c8e4971655b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.689100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faba791-71db-4c29-91ee-63a8cce2fa75 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.733586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5a920-901d-4986-870d-d6cf41352db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.735045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5a920-901d-4986-870d-d6cf41352db5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.735485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5a920-901d-4986-870d-d6cf41352db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.735834 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5a920-901d-4986-870d-d6cf41352db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.750842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5a920-901d-4986-870d-d6cf41352db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.752354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5a920-901d-4986-870d-d6cf41352db5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.755063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4b6b5-a3d4-4757-9f43-6c8e4971655b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a4c5a920-901d-4986-870d-d6cf41352db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:15.768645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:15.769671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:15.770586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:15.770586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:15.770586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:15.770586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 300/632] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:15.770586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5a920-901d-4986-870d-d6cf41352db5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.804238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1be8cc-3015-4135-b5f9-29a47995feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.804968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be8cc-3015-4135-b5f9-29a47995feef None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.805242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be8cc-3015-4135-b5f9-29a47995feef None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.805514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be8cc-3015-4135-b5f9-29a47995feef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.806239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1be8cc-3015-4135-b5f9-29a47995feef None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=c9c5d8bbcf07486ea3d3e26c81135d2f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:15.806545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1be8cc-3015-4135-b5f9-29a47995feef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.808010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1be8cc-3015-4135-b5f9-29a47995feef None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.815600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 333/633] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/role_assignments?user.id=c9c5d8bbcf07486ea3d3e26c81135d2f&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:15.819357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8486604-7b8b-4c98-bf54-beeaea9fdf45 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.820455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8486604-7b8b-4c98-bf54-beeaea9fdf45 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.820963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8486604-7b8b-4c98-bf54-beeaea9fdf45 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.827867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 334/634] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:15.827867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8486604-7b8b-4c98-bf54-beeaea9fdf45 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.836154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.863622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.914779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5a920-901d-4986-870d-d6cf41352db5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.974306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1b7db-0af8-41b0-85c6-7ef7b670fe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.974938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1b7db-0af8-41b0-85c6-7ef7b670fe4c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.975151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1b7db-0af8-41b0-85c6-7ef7b670fe4c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.975370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1b7db-0af8-41b0-85c6-7ef7b670fe4c None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.976144 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1b7db-0af8-41b0-85c6-7ef7b670fe4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:15.976448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1b7db-0af8-41b0-85c6-7ef7b670fe4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.978643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1b7db-0af8-41b0-85c6-7ef7b670fe4c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.982855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8486604-7b8b-4c98-bf54-beeaea9fdf45 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.001882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 301/635] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:16.002996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5a9ce-ae30-4414-860f-338c06be70e8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.003323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5a9ce-ae30-4414-860f-338c06be70e8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.003538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5a9ce-ae30-4414-860f-338c06be70e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.023578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a9d5a9ce-ae30-4414-860f-338c06be70e8 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:16.024846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a9d5a9ce-ae30-4414-860f-338c06be70e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:16.033144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3dc59-ecc3-4333-99b5-842ffa575098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.034170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3dc59-ecc3-4333-99b5-842ffa575098 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.034443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3dc59-ecc3-4333-99b5-842ffa575098 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.034737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3dc59-ecc3-4333-99b5-842ffa575098 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.035386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3dc59-ecc3-4333-99b5-842ffa575098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:16.035684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3dc59-ecc3-4333-99b5-842ffa575098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:16.037103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3dc59-ecc3-4333-99b5-842ffa575098 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:16.053197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 335/636] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:16.054417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3dc59-ecc3-4333-99b5-842ffa575098 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.138533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 302/637] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:16.140158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5a9ce-ae30-4414-860f-338c06be70e8 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.173805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:16.187156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:16.202517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3dc59-ecc3-4333-99b5-842ffa575098 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.253345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f12b-dec0-4dc5-8188-5f41cf1ce33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.253902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f12b-dec0-4dc5-8188-5f41cf1ce33d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.254178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f12b-dec0-4dc5-8188-5f41cf1ce33d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.254452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f12b-dec0-4dc5-8188-5f41cf1ce33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.267530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f12b-dec0-4dc5-8188-5f41cf1ce33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:16.269789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f12b-dec0-4dc5-8188-5f41cf1ce33d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:16.274939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5a9ce-ae30-4414-860f-338c06be70e8 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7b60f12b-dec0-4dc5-8188-5f41cf1ce33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:16.289991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:16.291200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:16.292415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:16.292415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:16.292415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:16.294999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 336/638] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:16.296536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28ac3d-3cff-47bf-83ea-fcbe155ad537 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.297006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28ac3d-3cff-47bf-83ea-fcbe155ad537 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.297920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28ac3d-3cff-47bf-83ea-fcbe155ad537 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.301424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 337/639] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:16.303300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28ac3d-3cff-47bf-83ea-fcbe155ad537 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.333814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53fa8e-95ff-4dba-87aa-fb008b7ff71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.334462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53fa8e-95ff-4dba-87aa-fb008b7ff71e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.334761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53fa8e-95ff-4dba-87aa-fb008b7ff71e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.335017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53fa8e-95ff-4dba-87aa-fb008b7ff71e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.345359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53fa8e-95ff-4dba-87aa-fb008b7ff71e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:16.347183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53fa8e-95ff-4dba-87aa-fb008b7ff71e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-ac53fa8e-95ff-4dba-87aa-fb008b7ff71e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:16.364392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:16.365624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:16.366803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 303/640] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:16.367478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412961f9-63bc-462b-b223-d036ee79dcbb None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.367478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412961f9-63bc-462b-b223-d036ee79dcbb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.367478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412961f9-63bc-462b-b223-d036ee79dcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.393616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-412961f9-63bc-462b-b223-d036ee79dcbb None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:16.395504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-412961f9-63bc-462b-b223-d036ee79dcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:16.452415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28ac3d-3cff-47bf-83ea-fcbe155ad537 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.487829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 304/641] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:16.488709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412961f9-63bc-462b-b223-d036ee79dcbb None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.522170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:16.525257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2ba0-c3dd-4380-9098-5e0c1b276cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.526210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2ba0-c3dd-4380-9098-5e0c1b276cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.532087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2ba0-c3dd-4380-9098-5e0c1b276cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.532827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2ba0-c3dd-4380-9098-5e0c1b276cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.534676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab2ba0-c3dd-4380-9098-5e0c1b276cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:16.535204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab2ba0-c3dd-4380-9098-5e0c1b276cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:16.536869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab2ba0-c3dd-4380-9098-5e0c1b276cc2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:16.539085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:16.554248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 338/642] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:16.555793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2ba0-c3dd-4380-9098-5e0c1b276cc2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.627267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412961f9-63bc-462b-b223-d036ee79dcbb None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.673415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e29b3-5f25-463d-9bfb-8efbda8e1135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.674176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e29b3-5f25-463d-9bfb-8efbda8e1135 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.674539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e29b3-5f25-463d-9bfb-8efbda8e1135 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.674935 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e29b3-5f25-463d-9bfb-8efbda8e1135 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.675817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e29b3-5f25-463d-9bfb-8efbda8e1135 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:16.676209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e29b3-5f25-463d-9bfb-8efbda8e1135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:16.677774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e29b3-5f25-463d-9bfb-8efbda8e1135 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:16.682881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2ba0-c3dd-4380-9098-5e0c1b276cc2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.700229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 305/643] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:16.701266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e29b3-5f25-463d-9bfb-8efbda8e1135 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.725187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efc091-89f6-4ef3-a67b-c1ea30bc792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.726243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efc091-89f6-4ef3-a67b-c1ea30bc792a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.726910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efc091-89f6-4ef3-a67b-c1ea30bc792a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.727362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efc091-89f6-4ef3-a67b-c1ea30bc792a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.740077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efc091-89f6-4ef3-a67b-c1ea30bc792a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e6efc091-89f6-4ef3-a67b-c1ea30bc792a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:16.745351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:16.746399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:16.747260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:16.749853 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 339/644] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:16.751833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efc091-89f6-4ef3-a67b-c1ea30bc792a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.795934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:16.815161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e29b3-5f25-463d-9bfb-8efbda8e1135 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.829896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:16.854194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69cf37-f2f3-4523-ad82-ac402780bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.854933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69cf37-f2f3-4523-ad82-ac402780bd77 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.855280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69cf37-f2f3-4523-ad82-ac402780bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.855623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69cf37-f2f3-4523-ad82-ac402780bd77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.864205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69cf37-f2f3-4523-ad82-ac402780bd77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:16.865657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69cf37-f2f3-4523-ad82-ac402780bd77 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4a69cf37-f2f3-4523-ad82-ac402780bd77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:16.877705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:16.878820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:16.880548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:16.880548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:16.880548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:16.880548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:16.880548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:16.880548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:16.880548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:16.880548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:16.881224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efc091-89f6-4ef3-a67b-c1ea30bc792a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.881343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 306/645] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:16.881343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69cf37-f2f3-4523-ad82-ac402780bd77 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.934577 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214ef17-c303-459c-a6c2-d9c9086e0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.935466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ef17-c303-459c-a6c2-d9c9086e0f13 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.935643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ef17-c303-459c-a6c2-d9c9086e0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.936074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ef17-c303-459c-a6c2-d9c9086e0f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:17.003075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69cf37-f2f3-4523-ad82-ac402780bd77 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:17.012318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214ef17-c303-459c-a6c2-d9c9086e0f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:17.014301 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214ef17-c303-459c-a6c2-d9c9086e0f13 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:17.045306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2155-27a4-4f44-992c-a7a9ffe1ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:17.046017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2155-27a4-4f44-992c-a7a9ffe1ca38 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:17.046242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2155-27a4-4f44-992c-a7a9ffe1ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:17.046610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2155-27a4-4f44-992c-a7a9ffe1ca38 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:17.048170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a2155-27a4-4f44-992c-a7a9ffe1ca38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:17.048723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a2155-27a4-4f44-992c-a7a9ffe1ca38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:17.050114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a2155-27a4-4f44-992c-a7a9ffe1ca38 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:17.063980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 307/646] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:17.063980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2155-27a4-4f44-992c-a7a9ffe1ca38 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:17.068946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:17.082938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:17.144039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 340/647] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:17.144906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214ef17-c303-459c-a6c2-d9c9086e0f13 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:17.220801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2155-27a4-4f44-992c-a7a9ffe1ca38 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:17.258054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214ef17-c303-459c-a6c2-d9c9086e0f13 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:17.269504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdaa83-89dd-4159-ae7e-34095f1d5b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:17.270550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdaa83-89dd-4159-ae7e-34095f1d5b73 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:17.270904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdaa83-89dd-4159-ae7e-34095f1d5b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:17.271180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdaa83-89dd-4159-ae7e-34095f1d5b73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:17.288304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdaa83-89dd-4159-ae7e-34095f1d5b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-becdaa83-89dd-4159-ae7e-34095f1d5b73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:17.294557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:17.295773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:17.296877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:17.298527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 308/648] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:17.299279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdaa83-89dd-4159-ae7e-34095f1d5b73 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:17.310017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70368-9ce5-4662-a620-a2cef7b49d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:17.310800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70368-9ce5-4662-a620-a2cef7b49d8c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:17.311174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70368-9ce5-4662-a620-a2cef7b49d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:17.311545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd70368-9ce5-4662-a620-a2cef7b49d8c None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:17.312381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd70368-9ce5-4662-a620-a2cef7b49d8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:17.312856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd70368-9ce5-4662-a620-a2cef7b49d8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:17.314797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd70368-9ce5-4662-a620-a2cef7b49d8c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:17.330144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 341/649] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:17.330821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70368-9ce5-4662-a620-a2cef7b49d8c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:17.351152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:17.391828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:17.433645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdaa83-89dd-4159-ae7e-34095f1d5b73 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:17.444852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd70368-9ce5-4662-a620-a2cef7b49d8c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:17.476324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052bfba-0a85-41ae-8e8f-ffce2661cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:17.477065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052bfba-0a85-41ae-8e8f-ffce2661cccd None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:17.477405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052bfba-0a85-41ae-8e8f-ffce2661cccd None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:17.477741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052bfba-0a85-41ae-8e8f-ffce2661cccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:17.487501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33be7db-60ae-4adf-99dd-98192156661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:17.488260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33be7db-60ae-4adf-99dd-98192156661d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:17.488416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33be7db-60ae-4adf-99dd-98192156661d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:17.488689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33be7db-60ae-4adf-99dd-98192156661d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:17.492219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052bfba-0a85-41ae-8e8f-ffce2661cccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:17.493797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052bfba-0a85-41ae-8e8f-ffce2661cccd None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:17.501858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33be7db-60ae-4adf-99dd-98192156661d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:17.503315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33be7db-60ae-4adf-99dd-98192156661d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-c052bfba-0a85-41ae-8e8f-ffce2661cccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:17.511297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:17.512482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:17.519703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:17.519703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:17.519703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:17.519703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 309/650] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:17.519703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052bfba-0a85-41ae-8e8f-ffce2661cccd None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c33be7db-60ae-4adf-99dd-98192156661d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:17.528815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:17.530072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:17.531877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:17.531877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:17.531877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:17.536337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 342/651] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:17.537860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33be7db-60ae-4adf-99dd-98192156661d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:17.614360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:17.648678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052bfba-0a85-41ae-8e8f-ffce2661cccd None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:17.668279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33be7db-60ae-4adf-99dd-98192156661d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:17.668872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:17.688970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa77bfe-7d58-46a1-9c8c-f8c620bb26be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:17.689670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa77bfe-7d58-46a1-9c8c-f8c620bb26be None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:17.689948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa77bfe-7d58-46a1-9c8c-f8c620bb26be None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:17.690220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa77bfe-7d58-46a1-9c8c-f8c620bb26be None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:17.690887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa77bfe-7d58-46a1-9c8c-f8c620bb26be None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:17.691183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa77bfe-7d58-46a1-9c8c-f8c620bb26be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:17.692601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa77bfe-7d58-46a1-9c8c-f8c620bb26be None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:17.701691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 310/652] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:17.704824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa77bfe-7d58-46a1-9c8c-f8c620bb26be None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:17.719815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb511d-59bb-4860-8dee-af3c74f982aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:17.721533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb511d-59bb-4860-8dee-af3c74f982aa None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:17.722216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb511d-59bb-4860-8dee-af3c74f982aa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:17.722899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb511d-59bb-4860-8dee-af3c74f982aa None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/62c91e3eec414a5189befb91012955c2/roles/ea287c8c7f9442cf99fb462bb85b39b2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:17.741456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb511d-59bb-4860-8dee-af3c74f982aa None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=62c91e3eec414a5189befb91012955c2, role_id=ea287c8c7f9442cf99fb462bb85b39b2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:17.742953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb511d-59bb-4860-8dee-af3c74f982aa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:17.814374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa77bfe-7d58-46a1-9c8c-f8c620bb26be None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:17.856000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f76830-198f-4733-b4ef-68d214ce1495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:17.856639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f76830-198f-4733-b4ef-68d214ce1495 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:17.856936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f76830-198f-4733-b4ef-68d214ce1495 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:17.857205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f76830-198f-4733-b4ef-68d214ce1495 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:17.857847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f76830-198f-4733-b4ef-68d214ce1495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:17.858143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f76830-198f-4733-b4ef-68d214ce1495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:17.859665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f76830-198f-4733-b4ef-68d214ce1495 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:17.871846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 311/653] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:17.872495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f76830-198f-4733-b4ef-68d214ce1495 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:17.883667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 343/654] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:59:17 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/62c91e3eec414a5189befb91012955c2/roles/ea287c8c7f9442cf99fb462bb85b39b2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:17.884996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb511d-59bb-4860-8dee-af3c74f982aa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:17.939441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.036212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb511d-59bb-4860-8dee-af3c74f982aa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.038319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f76830-198f-4733-b4ef-68d214ce1495 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.056390 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.076418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbc7bc-e89e-4a2f-a241-c4c7914a1b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.077061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbc7bc-e89e-4a2f-a241-c4c7914a1b85 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.077335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbc7bc-e89e-4a2f-a241-c4c7914a1b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.077604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbc7bc-e89e-4a2f-a241-c4c7914a1b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.089756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dad7-955a-40e3-b743-21244dc7f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.090388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dad7-955a-40e3-b743-21244dc7f7aa None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.090668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dad7-955a-40e3-b743-21244dc7f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.090938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dad7-955a-40e3-b743-21244dc7f7aa None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.091583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840dad7-955a-40e3-b743-21244dc7f7aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:18.092746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840dad7-955a-40e3-b743-21244dc7f7aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.094998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840dad7-955a-40e3-b743-21244dc7f7aa None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.095114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbc7bc-e89e-4a2f-a241-c4c7914a1b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.096637 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbc7bc-e89e-4a2f-a241-c4c7914a1b85 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.115770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 312/655] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:18.115770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dad7-955a-40e3-b743-21244dc7f7aa None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-95dbc7bc-e89e-4a2f-a241-c4c7914a1b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:18.121967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:18.122873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:18.123778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:18.123778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:18.123778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:18.123778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 344/656] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:18.123778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbc7bc-e89e-4a2f-a241-c4c7914a1b85 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.229833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbc7bc-e89e-4a2f-a241-c4c7914a1b85 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.238239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.244387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dad7-955a-40e3-b743-21244dc7f7aa None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.266311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d480f6-3d3c-4105-99a8-1c8cc5352213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.267074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d480f6-3d3c-4105-99a8-1c8cc5352213 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.267343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d480f6-3d3c-4105-99a8-1c8cc5352213 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.267606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d480f6-3d3c-4105-99a8-1c8cc5352213 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.274749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d480f6-3d3c-4105-99a8-1c8cc5352213 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.279073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d480f6-3d3c-4105-99a8-1c8cc5352213 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.286831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63b514-90ae-49c3-be7b-cc5720418f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.287530 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63b514-90ae-49c3-be7b-cc5720418f93 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.287842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63b514-90ae-49c3-be7b-cc5720418f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.288118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63b514-90ae-49c3-be7b-cc5720418f93 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b2d480f6-3d3c-4105-99a8-1c8cc5352213 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:18.290772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:18.291636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 345/657] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:18.297687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d480f6-3d3c-4105-99a8-1c8cc5352213 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.298231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63b514-90ae-49c3-be7b-cc5720418f93 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.298231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63b514-90ae-49c3-be7b-cc5720418f93 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-1b63b514-90ae-49c3-be7b-cc5720418f93 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:18.311638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:18.313374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:18.314430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 313/658] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:18.315035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95109e6-0937-48e0-bb96-e52744482e84 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.315035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95109e6-0937-48e0-bb96-e52744482e84 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.315156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95109e6-0937-48e0-bb96-e52744482e84 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.316538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 314/659] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:18.320747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95109e6-0937-48e0-bb96-e52744482e84 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.333796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.416774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d480f6-3d3c-4105-99a8-1c8cc5352213 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.438408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95109e6-0937-48e0-bb96-e52744482e84 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.455471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f47a05-ced3-4359-ace4-bf59b64cf8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.456120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f47a05-ced3-4359-ace4-bf59b64cf8ac None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.456399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f47a05-ced3-4359-ace4-bf59b64cf8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.456667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f47a05-ced3-4359-ace4-bf59b64cf8ac None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.457326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f47a05-ced3-4359-ace4-bf59b64cf8ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:18.457629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f47a05-ced3-4359-ace4-bf59b64cf8ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.458987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f47a05-ced3-4359-ace4-bf59b64cf8ac None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.471911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 346/660] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:18.472863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f47a05-ced3-4359-ace4-bf59b64cf8ac None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.480024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaece10a-a3c4-49e0-ba4d-eefde7364fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.480699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaece10a-a3c4-49e0-ba4d-eefde7364fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.480982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaece10a-a3c4-49e0-ba4d-eefde7364fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.481259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaece10a-a3c4-49e0-ba4d-eefde7364fb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.481964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaece10a-a3c4-49e0-ba4d-eefde7364fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:18.482326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaece10a-a3c4-49e0-ba4d-eefde7364fb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.483912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaece10a-a3c4-49e0-ba4d-eefde7364fb7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.496648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 315/661] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:18.497869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8b45-ec6b-41d4-8e62-d1dc99e3772f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.498149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8b45-ec6b-41d4-8e62-d1dc99e3772f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.498420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8b45-ec6b-41d4-8e62-d1dc99e3772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.519636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-60bd8b45-ec6b-41d4-8e62-d1dc99e3772f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:18.520955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-60bd8b45-ec6b-41d4-8e62-d1dc99e3772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:18.535911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.575669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.589220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f47a05-ced3-4359-ace4-bf59b64cf8ac None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.603844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 316/662] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:18.603844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8b45-ec6b-41d4-8e62-d1dc99e3772f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.636140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60941c-02b5-40c1-8b1e-2f9d7f555fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.637258 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60941c-02b5-40c1-8b1e-2f9d7f555fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.637679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60941c-02b5-40c1-8b1e-2f9d7f555fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.638217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60941c-02b5-40c1-8b1e-2f9d7f555fa2 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.639463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60941c-02b5-40c1-8b1e-2f9d7f555fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:18.640235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60941c-02b5-40c1-8b1e-2f9d7f555fa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.642883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60941c-02b5-40c1-8b1e-2f9d7f555fa2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.666768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 347/663] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:18.667966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60941c-02b5-40c1-8b1e-2f9d7f555fa2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.723033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8b45-ec6b-41d4-8e62-d1dc99e3772f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.759341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceb622-56f0-4d1f-8b5e-1134c1a16215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.760132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceb622-56f0-4d1f-8b5e-1134c1a16215 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.760485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceb622-56f0-4d1f-8b5e-1134c1a16215 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.761237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceb622-56f0-4d1f-8b5e-1134c1a16215 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.769367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ceb622-56f0-4d1f-8b5e-1134c1a16215 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.770887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ceb622-56f0-4d1f-8b5e-1134c1a16215 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e5ceb622-56f0-4d1f-8b5e-1134c1a16215 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:18.784386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:18.785446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:18.786362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 317/664] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:18.787173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceb622-56f0-4d1f-8b5e-1134c1a16215 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.791900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60941c-02b5-40c1-8b1e-2f9d7f555fa2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.799087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.828529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266273b2-5265-4efe-8e03-7f107e12f56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.829446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266273b2-5265-4efe-8e03-7f107e12f56a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.829898 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266273b2-5265-4efe-8e03-7f107e12f56a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.830308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266273b2-5265-4efe-8e03-7f107e12f56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.831166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266273b2-5265-4efe-8e03-7f107e12f56a None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=a8855e3e7fc84cd9ba1afaef4cc308c5) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:18.831658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266273b2-5265-4efe-8e03-7f107e12f56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.833274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266273b2-5265-4efe-8e03-7f107e12f56a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.847846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 348/665] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/role_assignments?user.id=a8855e3e7fc84cd9ba1afaef4cc308c5&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:18.849117 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266273b2-5265-4efe-8e03-7f107e12f56a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.868251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.902362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceb622-56f0-4d1f-8b5e-1134c1a16215 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.943203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc1dd-156f-48cd-8a0b-bdc8d073ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.943770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc1dd-156f-48cd-8a0b-bdc8d073ad1a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.944069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc1dd-156f-48cd-8a0b-bdc8d073ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.944342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc1dd-156f-48cd-8a0b-bdc8d073ad1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.018907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266273b2-5265-4efe-8e03-7f107e12f56a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.025292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adc1dd-156f-48cd-8a0b-bdc8d073ad1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:19.026894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adc1dd-156f-48cd-8a0b-bdc8d073ad1a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:19.041169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:19.069944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7f9c6-21f5-4c43-8594-05119e054671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.070582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7f9c6-21f5-4c43-8594-05119e054671 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.070860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7f9c6-21f5-4c43-8594-05119e054671 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.071132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7f9c6-21f5-4c43-8594-05119e054671 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.072639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7f9c6-21f5-4c43-8594-05119e054671 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:19.072639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7f9c6-21f5-4c43-8594-05119e054671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:19.074091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7f9c6-21f5-4c43-8594-05119e054671 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:19.100241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 349/666] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:19.101107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7f9c6-21f5-4c43-8594-05119e054671 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:19.182269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 318/667] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:19.183329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc1dd-156f-48cd-8a0b-bdc8d073ad1a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:19.197263 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:19.240646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7f9c6-21f5-4c43-8594-05119e054671 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.300813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105de8c-ba73-4fb1-97a9-3b45fd949b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.302221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105de8c-ba73-4fb1-97a9-3b45fd949b94 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.302990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105de8c-ba73-4fb1-97a9-3b45fd949b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.303884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105de8c-ba73-4fb1-97a9-3b45fd949b94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.317098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc1dd-156f-48cd-8a0b-bdc8d073ad1a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.323691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105de8c-ba73-4fb1-97a9-3b45fd949b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:19.328633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7105de8c-ba73-4fb1-97a9-3b45fd949b94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:19.335045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:19.336902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:19.338610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:19.342249 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 350/668] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:19.346154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105de8c-ba73-4fb1-97a9-3b45fd949b94 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:19.369609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddd297-1635-43f2-903a-c39d967884ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.370658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddd297-1635-43f2-903a-c39d967884ba None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.371061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddd297-1635-43f2-903a-c39d967884ba None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.371438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddd297-1635-43f2-903a-c39d967884ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.448561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddd297-1635-43f2-903a-c39d967884ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:19.450129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddd297-1635-43f2-903a-c39d967884ba None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:19.485239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105de8c-ba73-4fb1-97a9-3b45fd949b94 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.517901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:19.528195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010def6d-bf98-477b-a6a1-56e4423bf426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010def6d-bf98-477b-a6a1-56e4423bf426 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010def6d-bf98-477b-a6a1-56e4423bf426 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.534628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010def6d-bf98-477b-a6a1-56e4423bf426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.550643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010def6d-bf98-477b-a6a1-56e4423bf426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:19.552267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010def6d-bf98-477b-a6a1-56e4423bf426 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-010def6d-bf98-477b-a6a1-56e4423bf426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:19.575838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:19.577265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:19.578776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:19.578776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:19.578776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:19.578776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 351/669] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:19.580134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010def6d-bf98-477b-a6a1-56e4423bf426 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:19.586259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 319/670] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:19.588773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddd297-1635-43f2-903a-c39d967884ba None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:19.604351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:19.728175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddd297-1635-43f2-903a-c39d967884ba None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.728574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010def6d-bf98-477b-a6a1-56e4423bf426 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.777432 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851575d-80f2-4c52-a41d-ec3afd66cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.778116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851575d-80f2-4c52-a41d-ec3afd66cd8c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.778466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851575d-80f2-4c52-a41d-ec3afd66cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.778831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851575d-80f2-4c52-a41d-ec3afd66cd8c None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.779707 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851575d-80f2-4c52-a41d-ec3afd66cd8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:19.779994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d1725-71f7-497f-a4bf-3faccdc2ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.780214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851575d-80f2-4c52-a41d-ec3afd66cd8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:19.781044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d1725-71f7-497f-a4bf-3faccdc2ad69 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.781587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d1725-71f7-497f-a4bf-3faccdc2ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.781909 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851575d-80f2-4c52-a41d-ec3afd66cd8c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:19.782321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d1725-71f7-497f-a4bf-3faccdc2ad69 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.783186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d1725-71f7-497f-a4bf-3faccdc2ad69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:19.783693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d1725-71f7-497f-a4bf-3faccdc2ad69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:19.785557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d1725-71f7-497f-a4bf-3faccdc2ad69 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:19.799886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 320/671] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:19.799886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851575d-80f2-4c52-a41d-ec3afd66cd8c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:19.800210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 352/672] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:19.802704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d1725-71f7-497f-a4bf-3faccdc2ad69 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:19.868405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:19.893558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:19.933858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d1725-71f7-497f-a4bf-3faccdc2ad69 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.946087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851575d-80f2-4c52-a41d-ec3afd66cd8c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.974416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062207e-dde5-4fe8-844b-8b44331aaabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.975420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062207e-dde5-4fe8-844b-8b44331aaabe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.975974 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062207e-dde5-4fe8-844b-8b44331aaabe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.976450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062207e-dde5-4fe8-844b-8b44331aaabe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.989383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062207e-dde5-4fe8-844b-8b44331aaabe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:19.990829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062207e-dde5-4fe8-844b-8b44331aaabe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:19.994183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be08ee3-a0c8-4899-9ab5-37e75b55b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.995055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be08ee3-a0c8-4899-9ab5-37e75b55b4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.995601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be08ee3-a0c8-4899-9ab5-37e75b55b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.996271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be08ee3-a0c8-4899-9ab5-37e75b55b4d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1062207e-dde5-4fe8-844b-8b44331aaabe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:20.007530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:20.008582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:20.009489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:20.009489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:20.009489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:20.013793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 353/673] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:20.014292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be08ee3-a0c8-4899-9ab5-37e75b55b4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.014668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062207e-dde5-4fe8-844b-8b44331aaabe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.017461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be08ee3-a0c8-4899-9ab5-37e75b55b4d0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-7be08ee3-a0c8-4899-9ab5-37e75b55b4d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:20.036266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:20.037301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:20.038199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:20.038199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:20.038199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:20.042069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 321/674] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:20.043114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be08ee3-a0c8-4899-9ab5-37e75b55b4d0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.134034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:20.143445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062207e-dde5-4fe8-844b-8b44331aaabe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.170499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be08ee3-a0c8-4899-9ab5-37e75b55b4d0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.181111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7c954-1c4c-468d-aabb-f0599daa5c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.181765 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7c954-1c4c-468d-aabb-f0599daa5c07 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.182040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7c954-1c4c-468d-aabb-f0599daa5c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.182310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7c954-1c4c-468d-aabb-f0599daa5c07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.191865 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7c954-1c4c-468d-aabb-f0599daa5c07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.193428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7c954-1c4c-468d-aabb-f0599daa5c07 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.197107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-bcf7c954-1c4c-468d-aabb-f0599daa5c07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:20.205982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:20.212691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 354/675] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:20.213594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7c954-1c4c-468d-aabb-f0599daa5c07 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.223090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e6027-a996-49ad-8c63-d6039a0735dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.223931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e6027-a996-49ad-8c63-d6039a0735dc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.224213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e6027-a996-49ad-8c63-d6039a0735dc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.224481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e6027-a996-49ad-8c63-d6039a0735dc None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.225130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e6027-a996-49ad-8c63-d6039a0735dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:20.225430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e6027-a996-49ad-8c63-d6039a0735dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.226823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e6027-a996-49ad-8c63-d6039a0735dc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.245551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 322/676] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:20.245551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deba43-a60c-4a20-abcd-299fccf45860 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.245551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deba43-a60c-4a20-abcd-299fccf45860 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.245551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deba43-a60c-4a20-abcd-299fccf45860 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.248457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 323/677] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:20.249195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deba43-a60c-4a20-abcd-299fccf45860 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.340911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7c954-1c4c-468d-aabb-f0599daa5c07 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.366298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deba43-a60c-4a20-abcd-299fccf45860 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.379618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3d58b-688f-4d53-832c-818c889a0340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.380326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3d58b-688f-4d53-832c-818c889a0340 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.380728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3d58b-688f-4d53-832c-818c889a0340 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.381208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3d58b-688f-4d53-832c-818c889a0340 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.382107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3d58b-688f-4d53-832c-818c889a0340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:20.382343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3d58b-688f-4d53-832c-818c889a0340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.383782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3d58b-688f-4d53-832c-818c889a0340 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.401806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 355/678] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:20.401806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3d58b-688f-4d53-832c-818c889a0340 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.410308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfd812-e938-4f3d-b67a-617c4035e782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.410927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd812-e938-4f3d-b67a-617c4035e782 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.411755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd812-e938-4f3d-b67a-617c4035e782 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.412053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd812-e938-4f3d-b67a-617c4035e782 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.412755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfd812-e938-4f3d-b67a-617c4035e782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:20.413064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfd812-e938-4f3d-b67a-617c4035e782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.414968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfd812-e938-4f3d-b67a-617c4035e782 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.419029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:20.432858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 324/679] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:20.432858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27733-e9bc-4904-957a-9cf7098f6ff6 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.432858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27733-e9bc-4904-957a-9cf7098f6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.432858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27733-e9bc-4904-957a-9cf7098f6ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.449064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-cdd27733-e9bc-4904-957a-9cf7098f6ff6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:20.450260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cdd27733-e9bc-4904-957a-9cf7098f6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:20.489208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:20.517341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3d58b-688f-4d53-832c-818c889a0340 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.536199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 325/680] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:20.537546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd27733-e9bc-4904-957a-9cf7098f6ff6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.569194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6801ab1-b6b6-47b6-8a74-5480a8d70276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.569830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801ab1-b6b6-47b6-8a74-5480a8d70276 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.570105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801ab1-b6b6-47b6-8a74-5480a8d70276 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.570466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801ab1-b6b6-47b6-8a74-5480a8d70276 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.583967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6801ab1-b6b6-47b6-8a74-5480a8d70276 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.586196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6801ab1-b6b6-47b6-8a74-5480a8d70276 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d6801ab1-b6b6-47b6-8a74-5480a8d70276 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:20.602939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:20.603946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:20.604923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:20.612807 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 356/681] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Aug 31 10:59:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:20.613280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6801ab1-b6b6-47b6-8a74-5480a8d70276 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.676854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd27733-e9bc-4904-957a-9cf7098f6ff6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.731450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09f3ef-b1df-485e-87df-e2c3b4c16298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.733035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09f3ef-b1df-485e-87df-e2c3b4c16298 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.733375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09f3ef-b1df-485e-87df-e2c3b4c16298 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.733666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09f3ef-b1df-485e-87df-e2c3b4c16298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.738211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:20.742860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09f3ef-b1df-485e-87df-e2c3b4c16298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.744991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09f3ef-b1df-485e-87df-e2c3b4c16298 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-6f09f3ef-b1df-485e-87df-e2c3b4c16298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:20.761917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:20.767852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 326/682] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:20.768740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09f3ef-b1df-485e-87df-e2c3b4c16298 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.774464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6801ab1-b6b6-47b6-8a74-5480a8d70276 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.818517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaf385-8cce-43dd-8728-73b74b8561fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.819130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaf385-8cce-43dd-8728-73b74b8561fe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.819407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaf385-8cce-43dd-8728-73b74b8561fe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.819677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaf385-8cce-43dd-8728-73b74b8561fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.820587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeaf385-8cce-43dd-8728-73b74b8561fe None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=fae0faf062ba4b7a8270fc2ff92a10be) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:20.821073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:20.821232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeaf385-8cce-43dd-8728-73b74b8561fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.822446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeaf385-8cce-43dd-8728-73b74b8561fe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.835896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 357/683] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:20 2022] GET /identity/v3/role_assignments?user.id=fae0faf062ba4b7a8270fc2ff92a10be&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:20.835896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaf385-8cce-43dd-8728-73b74b8561fe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.929595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09f3ef-b1df-485e-87df-e2c3b4c16298 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.981125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1121e5-c83c-4a56-a290-5fec72f7c07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.981915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1121e5-c83c-4a56-a290-5fec72f7c07a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.982203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1121e5-c83c-4a56-a290-5fec72f7c07a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.982473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1121e5-c83c-4a56-a290-5fec72f7c07a None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.983225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1121e5-c83c-4a56-a290-5fec72f7c07a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:20.983535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1121e5-c83c-4a56-a290-5fec72f7c07a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.986054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1121e5-c83c-4a56-a290-5fec72f7c07a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.987233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaf385-8cce-43dd-8728-73b74b8561fe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.014503 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 327/684] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Aug 31 10:59:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:21.016259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1121e5-c83c-4a56-a290-5fec72f7c07a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.043482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4085989-1779-4e56-9574-83eb2ff21cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.044060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085989-1779-4e56-9574-83eb2ff21cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.044332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085989-1779-4e56-9574-83eb2ff21cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.044597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085989-1779-4e56-9574-83eb2ff21cc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.045297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4085989-1779-4e56-9574-83eb2ff21cc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:21.045597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4085989-1779-4e56-9574-83eb2ff21cc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:21.047766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4085989-1779-4e56-9574-83eb2ff21cc0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:21.057373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:21.065492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 358/685] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:21.066441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4085989-1779-4e56-9574-83eb2ff21cc0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.130160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:21.143710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1121e5-c83c-4a56-a290-5fec72f7c07a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.174188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4085989-1779-4e56-9574-83eb2ff21cc0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.179300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc178a-0d46-4756-86df-06fe0da6cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.179963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc178a-0d46-4756-86df-06fe0da6cc8f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.180242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc178a-0d46-4756-86df-06fe0da6cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.180513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc178a-0d46-4756-86df-06fe0da6cc8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.191925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc178a-0d46-4756-86df-06fe0da6cc8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4efc178a-0d46-4756-86df-06fe0da6cc8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:21.196656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:21.197754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:21.198618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 328/686] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:21.199314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0b75f-c285-46d1-b17b-875d19258063 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.199478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0b75f-c285-46d1-b17b-875d19258063 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.199766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0b75f-c285-46d1-b17b-875d19258063 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.201268 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 329/687] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:21.201978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0b75f-c285-46d1-b17b-875d19258063 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.222534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2149e71-ce81-4c82-aaa7-47c01ed7b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.223490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2149e71-ce81-4c82-aaa7-47c01ed7b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.224017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2149e71-ce81-4c82-aaa7-47c01ed7b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.224469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2149e71-ce81-4c82-aaa7-47c01ed7b0e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.302443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:21.306763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2149e71-ce81-4c82-aaa7-47c01ed7b0e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:21.308357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2149e71-ce81-4c82-aaa7-47c01ed7b0e4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:21.329548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0b75f-c285-46d1-b17b-875d19258063 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.368843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301891-03d8-4476-942b-38ae5f39465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.369613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301891-03d8-4476-942b-38ae5f39465a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.369752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301891-03d8-4476-942b-38ae5f39465a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.369975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2301891-03d8-4476-942b-38ae5f39465a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.370753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301891-03d8-4476-942b-38ae5f39465a None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=041de16601f342c1a9b18003773a0856) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:21.371001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301891-03d8-4476-942b-38ae5f39465a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:21.372485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2301891-03d8-4476-942b-38ae5f39465a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:21.378882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 330/688] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:21 2022] GET /identity/v3/role_assignments?user.id=041de16601f342c1a9b18003773a0856&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:21.379689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301891-03d8-4476-942b-38ae5f39465a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.404274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:21.441132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 359/689] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:21.442782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b3e08-1e93-4ba1-8cc5-f6ddadd7316f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.443231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b3e08-1e93-4ba1-8cc5-f6ddadd7316f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.443732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b3e08-1e93-4ba1-8cc5-f6ddadd7316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.464773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f86b3e08-1e93-4ba1-8cc5-f6ddadd7316f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:21.465990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f86b3e08-1e93-4ba1-8cc5-f6ddadd7316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:21.513826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2301891-03d8-4476-942b-38ae5f39465a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.556085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 360/690] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:21.557074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b3e08-1e93-4ba1-8cc5-f6ddadd7316f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.558202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61dbb0-1d40-48f6-b5b1-510726a0c8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.559085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61dbb0-1d40-48f6-b5b1-510726a0c8ae None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.559547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61dbb0-1d40-48f6-b5b1-510726a0c8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.560070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61dbb0-1d40-48f6-b5b1-510726a0c8ae None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.560926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61dbb0-1d40-48f6-b5b1-510726a0c8ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:21.561446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61dbb0-1d40-48f6-b5b1-510726a0c8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:21.563125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61dbb0-1d40-48f6-b5b1-510726a0c8ae None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:21.573172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 331/691] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:21.579558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61dbb0-1d40-48f6-b5b1-510726a0c8ae None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.596736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:21.688525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:21.689739 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b3e08-1e93-4ba1-8cc5-f6ddadd7316f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.716542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61dbb0-1d40-48f6-b5b1-510726a0c8ae None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.729675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42ae4b-5bb0-4b6a-95ed-9f752ae64a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.730403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42ae4b-5bb0-4b6a-95ed-9f752ae64a2f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.730753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42ae4b-5bb0-4b6a-95ed-9f752ae64a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.731092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42ae4b-5bb0-4b6a-95ed-9f752ae64a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.743447 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42ae4b-5bb0-4b6a-95ed-9f752ae64a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:21.745050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42ae4b-5bb0-4b6a-95ed-9f752ae64a2f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:21.758923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4345f-c549-45f9-b68d-050445516eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.759908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4345f-c549-45f9-b68d-050445516eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.760522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4345f-c549-45f9-b68d-050445516eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.760998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4345f-c549-45f9-b68d-050445516eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0e42ae4b-5bb0-4b6a-95ed-9f752ae64a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:21.762591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:21.763579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:21.764548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:21.764548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:21.764548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:21.764548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 361/692] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:21.772903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42ae4b-5bb0-4b6a-95ed-9f752ae64a2f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.782301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4345f-c549-45f9-b68d-050445516eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:21.784385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4345f-c549-45f9-b68d-050445516eb4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3ab4345f-c549-45f9-b68d-050445516eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:21.809444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:21.810431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:21.811332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:21.811332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:21.811332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:21.811332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 332/693] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:21.818571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4345f-c549-45f9-b68d-050445516eb4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.925139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:21.947999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42ae4b-5bb0-4b6a-95ed-9f752ae64a2f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.960430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4345f-c549-45f9-b68d-050445516eb4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.996681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987299a-b664-48a5-9f09-78d6ba3b2a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.997556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987299a-b664-48a5-9f09-78d6ba3b2a6b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.997938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987299a-b664-48a5-9f09-78d6ba3b2a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.998369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987299a-b664-48a5-9f09-78d6ba3b2a6b None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.999240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987299a-b664-48a5-9f09-78d6ba3b2a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:21.999647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987299a-b664-48a5-9f09-78d6ba3b2a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.000867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.002242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987299a-b664-48a5-9f09-78d6ba3b2a6b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.013659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993edc-45a8-49bd-a501-cc7419210f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.014816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993edc-45a8-49bd-a501-cc7419210f86 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.015242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993edc-45a8-49bd-a501-cc7419210f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.015863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993edc-45a8-49bd-a501-cc7419210f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.030849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20993edc-45a8-49bd-a501-cc7419210f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:22.030849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20993edc-45a8-49bd-a501-cc7419210f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.031670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 362/694] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:22.031670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987299a-b664-48a5-9f09-78d6ba3b2a6b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.031893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20993edc-45a8-49bd-a501-cc7419210f86 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.040270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 333/695] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:22.041643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993edc-45a8-49bd-a501-cc7419210f86 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.165679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987299a-b664-48a5-9f09-78d6ba3b2a6b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.194275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993edc-45a8-49bd-a501-cc7419210f86 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.206817 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd70da-619d-4be7-895c-37e49e8bbff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.207462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd70da-619d-4be7-895c-37e49e8bbff7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.207754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd70da-619d-4be7-895c-37e49e8bbff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.208058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd70da-619d-4be7-895c-37e49e8bbff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.220098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd70da-619d-4be7-895c-37e49e8bbff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.221633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd70da-619d-4be7-895c-37e49e8bbff7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.224286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.241372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c5928-afca-4773-a881-6e12a1c18480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.242337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c5928-afca-4773-a881-6e12a1c18480 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.254654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c5928-afca-4773-a881-6e12a1c18480 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.254654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c5928-afca-4773-a881-6e12a1c18480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-efdd70da-619d-4be7-895c-37e49e8bbff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:22.254862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:22.255813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:22.256748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:22.256748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:22.256748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:22.256748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 363/696] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:22.256748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd70da-619d-4be7-895c-37e49e8bbff7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.261411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c5928-afca-4773-a881-6e12a1c18480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.263892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c5928-afca-4773-a881-6e12a1c18480 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-2e8c5928-afca-4773-a881-6e12a1c18480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:22.287286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:22.288259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:22.289169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:22.289169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:22.289169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:22.289169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:22.289169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:22.289169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:22.289169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:22.289169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:22.290334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 334/697] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:22.291409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c5928-afca-4773-a881-6e12a1c18480 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.358226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.392801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd70da-619d-4be7-895c-37e49e8bbff7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.431235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c5928-afca-4773-a881-6e12a1c18480 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.436216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55442c-93cb-4619-b2f8-94caf419f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.436974 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55442c-93cb-4619-b2f8-94caf419f0df None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.437443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55442c-93cb-4619-b2f8-94caf419f0df None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.438327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55442c-93cb-4619-b2f8-94caf419f0df None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.448986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55442c-93cb-4619-b2f8-94caf419f0df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.450914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55442c-93cb-4619-b2f8-94caf419f0df None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-da55442c-93cb-4619-b2f8-94caf419f0df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:22.466515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:22.467710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:22.468890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:22.471893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 364/698] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:22.472947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55442c-93cb-4619-b2f8-94caf419f0df None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.475406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea236f-0220-4941-8457-c467c8a7ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.476312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea236f-0220-4941-8457-c467c8a7ee92 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.476764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea236f-0220-4941-8457-c467c8a7ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.477278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea236f-0220-4941-8457-c467c8a7ee92 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.478498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea236f-0220-4941-8457-c467c8a7ee92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:22.479099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea236f-0220-4941-8457-c467c8a7ee92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.480701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea236f-0220-4941-8457-c467c8a7ee92 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.496303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 335/699] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:22.497624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea236f-0220-4941-8457-c467c8a7ee92 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.542988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.607568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55442c-93cb-4619-b2f8-94caf419f0df None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.613711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea236f-0220-4941-8457-c467c8a7ee92 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.622090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.653128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84406075-feb2-4ba3-9267-2035197ad934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.654139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84406075-feb2-4ba3-9267-2035197ad934 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.654817 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84406075-feb2-4ba3-9267-2035197ad934 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.655276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84406075-feb2-4ba3-9267-2035197ad934 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.657604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84406075-feb2-4ba3-9267-2035197ad934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:22.658118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84406075-feb2-4ba3-9267-2035197ad934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.659859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84406075-feb2-4ba3-9267-2035197ad934 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.669612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4084-1426-473c-a98b-0d523979d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.670219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4084-1426-473c-a98b-0d523979d217 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.670756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4084-1426-473c-a98b-0d523979d217 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.671264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4084-1426-473c-a98b-0d523979d217 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.672866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead4084-1426-473c-a98b-0d523979d217 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:22.673265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead4084-1426-473c-a98b-0d523979d217 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.674799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead4084-1426-473c-a98b-0d523979d217 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.683699 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 365/700] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:22.683699 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84406075-feb2-4ba3-9267-2035197ad934 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.697166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 336/701] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:22.702683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4084-1426-473c-a98b-0d523979d217 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.803532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84406075-feb2-4ba3-9267-2035197ad934 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.811347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4084-1426-473c-a98b-0d523979d217 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.820835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.845430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41278b3d-25af-4858-8e0b-cc258afd91ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.846354 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41278b3d-25af-4858-8e0b-cc258afd91ea None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.846956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41278b3d-25af-4858-8e0b-cc258afd91ea None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.847561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41278b3d-25af-4858-8e0b-cc258afd91ea None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.848544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41278b3d-25af-4858-8e0b-cc258afd91ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.850088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e9c2c-d55c-4133-8dfa-c32e421a692e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.850822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e9c2c-d55c-4133-8dfa-c32e421a692e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.851122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41278b3d-25af-4858-8e0b-cc258afd91ea None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.851230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e9c2c-d55c-4133-8dfa-c32e421a692e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.851511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e9c2c-d55c-4133-8dfa-c32e421a692e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.852409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e9c2c-d55c-4133-8dfa-c32e421a692e None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=c9c5d8bbcf07486ea3d3e26c81135d2f) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:22.852795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e9c2c-d55c-4133-8dfa-c32e421a692e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.854379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e9c2c-d55c-4133-8dfa-c32e421a692e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.867778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 337/702] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/role_assignments?user.id=c9c5d8bbcf07486ea3d3e26c81135d2f&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=55aed406476a485f99f9815f9f27cb3b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:22.867778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e9c2c-d55c-4133-8dfa-c32e421a692e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.900167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.928242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 366/703] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 10:59:22 2022] POST /identity/v3/users => generated 254 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:23.025479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e9c2c-d55c-4133-8dfa-c32e421a692e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:23.051336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed10e86-1aa0-4a1e-ae83-38f96d79b963 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.051651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed10e86-1aa0-4a1e-ae83-38f96d79b963 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.052076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed10e86-1aa0-4a1e-ae83-38f96d79b963 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.053981 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 367/704] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:59:23.059621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fd74a-4abb-4b2c-82d2-f5ef5680d28f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.059982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fd74a-4abb-4b2c-82d2-f5ef5680d28f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.060259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fd74a-4abb-4b2c-82d2-f5ef5680d28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.068959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e6143-cab7-4ea1-b03f-63635a78341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:23.069594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e6143-cab7-4ea1-b03f-63635a78341e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.069869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e6143-cab7-4ea1-b03f-63635a78341e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.070139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e6143-cab7-4ea1-b03f-63635a78341e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.090537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fb4fd74a-4abb-4b2c-82d2-f5ef5680d28f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:23.092310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fb4fd74a-4abb-4b2c-82d2-f5ef5680d28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:23.150107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e6143-cab7-4ea1-b03f-63635a78341e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:23.151600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e6143-cab7-4ea1-b03f-63635a78341e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:23.184180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:23.251106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 368/705] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:23.271155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 338/706] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:23.282019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fd74a-4abb-4b2c-82d2-f5ef5680d28f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:23.394566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:23.398198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fd74a-4abb-4b2c-82d2-f5ef5680d28f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:23.438097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac01cd-5f65-4bf9-a5dd-b31c67dc2f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:23.438751 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac01cd-5f65-4bf9-a5dd-b31c67dc2f33 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.439028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac01cd-5f65-4bf9-a5dd-b31c67dc2f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.439298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac01cd-5f65-4bf9-a5dd-b31c67dc2f33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.450986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac01cd-5f65-4bf9-a5dd-b31c67dc2f33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:23.452803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac01cd-5f65-4bf9-a5dd-b31c67dc2f33 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-12ac01cd-5f65-4bf9-a5dd-b31c67dc2f33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:23.471091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:23.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:23.473094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:23.473094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:23.473094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:23.473094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 369/707] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:23.478516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e6143-cab7-4ea1-b03f-63635a78341e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:23.571485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac01cd-5f65-4bf9-a5dd-b31c67dc2f33 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:23.591532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e6143-cab7-4ea1-b03f-63635a78341e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:23.624654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:23.633201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc9baa-d53a-4c40-a0eb-985e5b14f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:23.633823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9baa-d53a-4c40-a0eb-985e5b14f0eb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.634128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9baa-d53a-4c40-a0eb-985e5b14f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.634374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc9baa-d53a-4c40-a0eb-985e5b14f0eb None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.635024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc9baa-d53a-4c40-a0eb-985e5b14f0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:23.635326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc9baa-d53a-4c40-a0eb-985e5b14f0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:23.638117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc9baa-d53a-4c40-a0eb-985e5b14f0eb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:23.650449 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 339/708] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:23.656930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc9baa-d53a-4c40-a0eb-985e5b14f0eb None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:23.742244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac01cd-5f65-4bf9-a5dd-b31c67dc2f33 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:23.787806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc9baa-d53a-4c40-a0eb-985e5b14f0eb None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:23.819402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3791da-aee2-4131-89fd-b6360bc7f5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:23.820388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3791da-aee2-4131-89fd-b6360bc7f5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.820670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3791da-aee2-4131-89fd-b6360bc7f5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.820943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3791da-aee2-4131-89fd-b6360bc7f5d8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.821974 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3791da-aee2-4131-89fd-b6360bc7f5d8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:23.824212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3791da-aee2-4131-89fd-b6360bc7f5d8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:23.834777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f777267-38ed-4c34-8567-a191d1f58366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:23.835408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777267-38ed-4c34-8567-a191d1f58366 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.835684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777267-38ed-4c34-8567-a191d1f58366 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.835996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777267-38ed-4c34-8567-a191d1f58366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4b3791da-aee2-4131-89fd-b6360bc7f5d8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:23.840285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:23.841288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:23.842101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 370/709] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Aug 31 10:59:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:23.843385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47925-3235-45d3-bbfb-536f39d92723 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.844294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777267-38ed-4c34-8567-a191d1f58366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:23.844503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47925-3235-45d3-bbfb-536f39d92723 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.847785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47925-3235-45d3-bbfb-536f39d92723 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.848049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777267-38ed-4c34-8567-a191d1f58366 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:23.851017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 371/710] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:23.852677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47925-3235-45d3-bbfb-536f39d92723 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-5f777267-38ed-4c34-8567-a191d1f58366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:23.865739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:23.867500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:23.869408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:23.869408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:23.869408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:23.869408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:23.869408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:23.869408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:23.869408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:23.869408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:23.870390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 340/711] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:23.870929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:23.872653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c588-0086-4457-87b1-e06498c629ce None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.872653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c588-0086-4457-87b1-e06498c629ce None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.872653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c588-0086-4457-87b1-e06498c629ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.895245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-77a9c588-0086-4457-87b1-e06498c629ce None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:23.896686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-77a9c588-0086-4457-87b1-e06498c629ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:23.963710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:23.983629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47925-3235-45d3-bbfb-536f39d92723 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:23.995850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 341/712] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:23.996763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c588-0086-4457-87b1-e06498c629ce None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.053214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7f3bc-660d-4afc-a522-a8c08530a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.054143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7f3bc-660d-4afc-a522-a8c08530a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.054417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7f3bc-660d-4afc-a522-a8c08530a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.055030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7f3bc-660d-4afc-a522-a8c08530a2f1 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.055671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7f3bc-660d-4afc-a522-a8c08530a2f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:24.055993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7f3bc-660d-4afc-a522-a8c08530a2f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.058819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7f3bc-660d-4afc-a522-a8c08530a2f1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.067918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 372/713] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Aug 31 10:59:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:24.074389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7f3bc-660d-4afc-a522-a8c08530a2f1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.201304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c588-0086-4457-87b1-e06498c629ce None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.239795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:24.277515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaa4ee-b841-4f9e-9cbd-9ff9c96f2d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.278891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaa4ee-b841-4f9e-9cbd-9ff9c96f2d9a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.279367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaa4ee-b841-4f9e-9cbd-9ff9c96f2d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.280014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaa4ee-b841-4f9e-9cbd-9ff9c96f2d9a None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.282593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7f3bc-660d-4afc-a522-a8c08530a2f1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.283573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaa4ee-b841-4f9e-9cbd-9ff9c96f2d9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:24.284116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaa4ee-b841-4f9e-9cbd-9ff9c96f2d9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.285913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaa4ee-b841-4f9e-9cbd-9ff9c96f2d9a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.307534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 342/714] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:24.308624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaa4ee-b841-4f9e-9cbd-9ff9c96f2d9a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.331455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f285fb-afdf-4e9a-9968-359e1dca319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.332010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f285fb-afdf-4e9a-9968-359e1dca319e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.332282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f285fb-afdf-4e9a-9968-359e1dca319e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.332549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f285fb-afdf-4e9a-9968-359e1dca319e None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.333588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f285fb-afdf-4e9a-9968-359e1dca319e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:24.333889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f285fb-afdf-4e9a-9968-359e1dca319e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.335737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f285fb-afdf-4e9a-9968-359e1dca319e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.343378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 373/715] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Aug 31 10:59:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:24.348710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f285fb-afdf-4e9a-9968-359e1dca319e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.379723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:24.451232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaa4ee-b841-4f9e-9cbd-9ff9c96f2d9a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.491939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2937b-5b06-439b-afb6-1be14cee1cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.492582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2937b-5b06-439b-afb6-1be14cee1cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.492858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2937b-5b06-439b-afb6-1be14cee1cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.493128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2937b-5b06-439b-afb6-1be14cee1cb4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.493711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2937b-5b06-439b-afb6-1be14cee1cb4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.495076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2937b-5b06-439b-afb6-1be14cee1cb4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4dc2937b-5b06-439b-afb6-1be14cee1cb4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:24.507349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:24.508578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:24.509470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 343/716] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:24 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:24.520846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2937b-5b06-439b-afb6-1be14cee1cb4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.606814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f285fb-afdf-4e9a-9968-359e1dca319e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.643145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2937b-5b06-439b-afb6-1be14cee1cb4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.645468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:24.666008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fed56-7d22-47f3-95c4-ba5664d3a462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.666874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fed56-7d22-47f3-95c4-ba5664d3a462 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.667315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fed56-7d22-47f3-95c4-ba5664d3a462 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.667728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fed56-7d22-47f3-95c4-ba5664d3a462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.668755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fed56-7d22-47f3-95c4-ba5664d3a462 None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=62c91e3eec414a5189befb91012955c2) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:24.669226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fed56-7d22-47f3-95c4-ba5664d3a462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.670872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fed56-7d22-47f3-95c4-ba5664d3a462 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.679411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 374/717] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:24 2022] GET /identity/v3/role_assignments?user.id=62c91e3eec414a5189befb91012955c2&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:24.687156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521050f6-a3f2-4906-800f-6ceba0e73932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.691536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521050f6-a3f2-4906-800f-6ceba0e73932 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.691536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521050f6-a3f2-4906-800f-6ceba0e73932 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.691536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521050f6-a3f2-4906-800f-6ceba0e73932 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.691536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521050f6-a3f2-4906-800f-6ceba0e73932 None admin] RBAC: Adding query filter params (name=network) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:24.691536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521050f6-a3f2-4906-800f-6ceba0e73932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.693321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521050f6-a3f2-4906-800f-6ceba0e73932 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.699526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 344/718] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:24.708831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fed56-7d22-47f3-95c4-ba5664d3a462 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.722632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:24.843243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fed56-7d22-47f3-95c4-ba5664d3a462 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.882238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b94bf1-ae45-4773-9ae6-0adbf4342d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.882764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b94bf1-ae45-4773-9ae6-0adbf4342d44 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.883082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b94bf1-ae45-4773-9ae6-0adbf4342d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.883354 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b94bf1-ae45-4773-9ae6-0adbf4342d44 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.884264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b94bf1-ae45-4773-9ae6-0adbf4342d44 None admin] RBAC: Adding query filter params (type=network) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:24.884566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b94bf1-ae45-4773-9ae6-0adbf4342d44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.885943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b94bf1-ae45-4773-9ae6-0adbf4342d44 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.892103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 375/719] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:25.198743 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98da05-c47a-41b2-b4a0-c219627ad169 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.198984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98da05-c47a-41b2-b4a0-c219627ad169 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.199195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98da05-c47a-41b2-b4a0-c219627ad169 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.201088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 345/720] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:25.206932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f2d2a-d824-45df-b567-011bc8613db4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.207219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f2d2a-d824-45df-b567-011bc8613db4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.207496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f2d2a-d824-45df-b567-011bc8613db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.236807 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ee9f2d2a-d824-45df-b567-011bc8613db4 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:25.238107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ee9f2d2a-d824-45df-b567-011bc8613db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.335526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:25.340917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 376/721] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:25.693780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98da05-c47a-41b2-b4a0-c219627ad169 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.843382 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98da05-c47a-41b2-b4a0-c219627ad169 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.895444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4c802-775b-485d-b5a4-83a7a53c5d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.896483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c802-775b-485d-b5a4-83a7a53c5d38 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.896961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c802-775b-485d-b5a4-83a7a53c5d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.897428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c802-775b-485d-b5a4-83a7a53c5d38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.912907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4c802-775b-485d-b5a4-83a7a53c5d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-6dc4c802-775b-485d-b5a4-83a7a53c5d38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:25.918069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:25.919004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:25.919880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:25.922732 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 346/722] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:25.932887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f2d2a-d824-45df-b567-011bc8613db4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.005991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3358a2-c098-4bb7-bbc5-fc19d2b7c511 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.006546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3358a2-c098-4bb7-bbc5-fc19d2b7c511 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.006976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3358a2-c098-4bb7-bbc5-fc19d2b7c511 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.008785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 347/723] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:59:26.029628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858ceaa-4bc7-46e9-8252-a385aa4ca69a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.029914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858ceaa-4bc7-46e9-8252-a385aa4ca69a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.030186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858ceaa-4bc7-46e9-8252-a385aa4ca69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.065840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a858ceaa-4bc7-46e9-8252-a385aa4ca69a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:26.067050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a858ceaa-4bc7-46e9-8252-a385aa4ca69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:26.119212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:26.129198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f2d2a-d824-45df-b567-011bc8613db4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.205966 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 348/724] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:26.206339 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2b1b-b518-45c1-af72-9102a1082371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.206970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2b1b-b518-45c1-af72-9102a1082371 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.207363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2b1b-b518-45c1-af72-9102a1082371 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.207363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2b1b-b518-45c1-af72-9102a1082371 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.207363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2b1b-b518-45c1-af72-9102a1082371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:26.207363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2b1b-b518-45c1-af72-9102a1082371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.209980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2b1b-b518-45c1-af72-9102a1082371 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.224180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 377/725] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:26.229766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858ceaa-4bc7-46e9-8252-a385aa4ca69a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.424904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858ceaa-4bc7-46e9-8252-a385aa4ca69a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.463073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefb8f2-61be-4ebd-a614-c02963edc4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.463709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefb8f2-61be-4ebd-a614-c02963edc4ef None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.464013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefb8f2-61be-4ebd-a614-c02963edc4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.464287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefb8f2-61be-4ebd-a614-c02963edc4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.476070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefb8f2-61be-4ebd-a614-c02963edc4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.477512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefb8f2-61be-4ebd-a614-c02963edc4ef None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-fdefb8f2-61be-4ebd-a614-c02963edc4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:26.497326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:26.499578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:26.502031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:26.502031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:26.502031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:26.502031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 349/726] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:26.509050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2b1b-b518-45c1-af72-9102a1082371 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.586871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:26.628964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2b1b-b518-45c1-af72-9102a1082371 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.641908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefb8f2-61be-4ebd-a614-c02963edc4ef None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.662400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:26.670624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba28da-9f11-4d17-852a-f29d2bf0eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.671246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba28da-9f11-4d17-852a-f29d2bf0eb46 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.671545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba28da-9f11-4d17-852a-f29d2bf0eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.671847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba28da-9f11-4d17-852a-f29d2bf0eb46 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.672522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba28da-9f11-4d17-852a-f29d2bf0eb46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:26.673685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba28da-9f11-4d17-852a-f29d2bf0eb46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.675375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba28da-9f11-4d17-852a-f29d2bf0eb46 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.692230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 378/727] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:26.699161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba28da-9f11-4d17-852a-f29d2bf0eb46 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.813948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefb8f2-61be-4ebd-a614-c02963edc4ef None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.879654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba28da-9f11-4d17-852a-f29d2bf0eb46 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.909686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec163f-11c0-432d-9330-6a5aeefb33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.910439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec163f-11c0-432d-9330-6a5aeefb33e7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.910779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec163f-11c0-432d-9330-6a5aeefb33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.911056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec163f-11c0-432d-9330-6a5aeefb33e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.911166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:26.924581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb591-29da-40ff-874a-ced27dd74583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.925570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb591-29da-40ff-874a-ced27dd74583 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.926918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb591-29da-40ff-874a-ced27dd74583 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.927274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb591-29da-40ff-874a-ced27dd74583 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.938902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec163f-11c0-432d-9330-6a5aeefb33e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:26.945213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb591-29da-40ff-874a-ced27dd74583 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.946694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb591-29da-40ff-874a-ced27dd74583 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d7ec163f-11c0-432d-9330-6a5aeefb33e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:26.950035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:26.951201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:26.952139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 350/728] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:26.957231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec163f-11c0-432d-9330-6a5aeefb33e7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ce4bb591-29da-40ff-874a-ced27dd74583 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:26.977487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:26.978912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:26.981212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:26.985403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 379/729] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:26.991857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb591-29da-40ff-874a-ced27dd74583 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.068508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:27.117735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec163f-11c0-432d-9330-6a5aeefb33e7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.143324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb591-29da-40ff-874a-ced27dd74583 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.167248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb47f88-7208-44b7-8147-d2b42ccec437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.168158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb47f88-7208-44b7-8147-d2b42ccec437 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.168441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb47f88-7208-44b7-8147-d2b42ccec437 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.169128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb47f88-7208-44b7-8147-d2b42ccec437 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.169816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb47f88-7208-44b7-8147-d2b42ccec437 None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:27.170159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb47f88-7208-44b7-8147-d2b42ccec437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.171867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb47f88-7208-44b7-8147-d2b42ccec437 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.187290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 351/730] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:27.188758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923638b5-4c13-4254-ad78-e415ca6d333a None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.189048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923638b5-4c13-4254-ad78-e415ca6d333a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.189575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923638b5-4c13-4254-ad78-e415ca6d333a None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.190676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d29752-e0b1-4ccd-8e41-68a7294b953d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.191186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 352/731] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:27.191671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d29752-e0b1-4ccd-8e41-68a7294b953d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.191979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d29752-e0b1-4ccd-8e41-68a7294b953d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.192257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d29752-e0b1-4ccd-8e41-68a7294b953d None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.192361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923638b5-4c13-4254-ad78-e415ca6d333a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.193075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d29752-e0b1-4ccd-8e41-68a7294b953d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:27.193390 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d29752-e0b1-4ccd-8e41-68a7294b953d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.194926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d29752-e0b1-4ccd-8e41-68a7294b953d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.216862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 380/732] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:27.218543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e24209-e9a8-45c5-9450-a1da8a457fa5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.219364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e24209-e9a8-45c5-9450-a1da8a457fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.219642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e24209-e9a8-45c5-9450-a1da8a457fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.239234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-46e24209-e9a8-45c5-9450-a1da8a457fa5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:27.240480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-46e24209-e9a8-45c5-9450-a1da8a457fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:27.283349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:27.313251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923638b5-4c13-4254-ad78-e415ca6d333a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.322241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 381/733] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:27.323201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e24209-e9a8-45c5-9450-a1da8a457fa5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.345302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:27.351494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dff1b-46c8-4ec0-aea8-85a8cba9b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.352209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dff1b-46c8-4ec0-aea8-85a8cba9b696 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.352522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dff1b-46c8-4ec0-aea8-85a8cba9b696 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.352751 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dff1b-46c8-4ec0-aea8-85a8cba9b696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.365358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dff1b-46c8-4ec0-aea8-85a8cba9b696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.366856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dff1b-46c8-4ec0-aea8-85a8cba9b696 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-404dff1b-46c8-4ec0-aea8-85a8cba9b696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:27.382761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:27.383814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:27.384988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:27.384988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:27.384988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:27.384988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 353/734] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:27.389907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dff1b-46c8-4ec0-aea8-85a8cba9b696 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.453466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e24209-e9a8-45c5-9450-a1da8a457fa5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.494482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d7859-4601-4745-9955-b53972b51410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.495528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d7859-4601-4745-9955-b53972b51410 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.496059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d7859-4601-4745-9955-b53972b51410 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.496555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d7859-4601-4745-9955-b53972b51410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.509468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d7859-4601-4745-9955-b53972b51410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.511399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d7859-4601-4745-9955-b53972b51410 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-651d7859-4601-4745-9955-b53972b51410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:27.529682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:27.531896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:27.532860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:27.532860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:27.532860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:27.532860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 382/735] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:27.533092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8957a50-0d31-40f0-89ad-9b3f2b608f86 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.533622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8957a50-0d31-40f0-89ad-9b3f2b608f86 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.533622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8957a50-0d31-40f0-89ad-9b3f2b608f86 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.535854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 383/736] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:27.544779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8957a50-0d31-40f0-89ad-9b3f2b608f86 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.568910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dff1b-46c8-4ec0-aea8-85a8cba9b696 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.576830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:27.605605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34e167-24b1-4ef8-bdac-d7f39d82c41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.606281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e167-24b1-4ef8-bdac-d7f39d82c41e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.606509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e167-24b1-4ef8-bdac-d7f39d82c41e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.606788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e167-24b1-4ef8-bdac-d7f39d82c41e None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.607567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34e167-24b1-4ef8-bdac-d7f39d82c41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:27.608123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34e167-24b1-4ef8-bdac-d7f39d82c41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.609316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34e167-24b1-4ef8-bdac-d7f39d82c41e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.622237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 354/737] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:27.623495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18026f-0969-418e-9327-d2f86823dc79 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.628230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18026f-0969-418e-9327-d2f86823dc79 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.628679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18026f-0969-418e-9327-d2f86823dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.647960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0b18026f-0969-418e-9327-d2f86823dc79 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:27.649183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0b18026f-0969-418e-9327-d2f86823dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:27.669060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8957a50-0d31-40f0-89ad-9b3f2b608f86 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.693856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:27.709245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab37167-a4c7-4d2b-b02b-09f98fc64707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.709773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab37167-a4c7-4d2b-b02b-09f98fc64707 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.710053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab37167-a4c7-4d2b-b02b-09f98fc64707 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.710357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab37167-a4c7-4d2b-b02b-09f98fc64707 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.711004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab37167-a4c7-4d2b-b02b-09f98fc64707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:27.711303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab37167-a4c7-4d2b-b02b-09f98fc64707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.712749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab37167-a4c7-4d2b-b02b-09f98fc64707 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.726156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 384/738] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:27.727013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab37167-a4c7-4d2b-b02b-09f98fc64707 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.732789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 355/739] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:27.733669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18026f-0969-418e-9327-d2f86823dc79 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.839967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:27.860469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab37167-a4c7-4d2b-b02b-09f98fc64707 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.864308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18026f-0969-418e-9327-d2f86823dc79 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.898607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b956ac-916a-4088-a572-f77281628ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.899345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b956ac-916a-4088-a572-f77281628ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.899623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b956ac-916a-4088-a572-f77281628ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.899919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b956ac-916a-4088-a572-f77281628ea7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.903701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738279c-33c3-43cd-9658-3ba25a1c3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.904339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738279c-33c3-43cd-9658-3ba25a1c3c1f None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.904614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738279c-33c3-43cd-9658-3ba25a1c3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.904879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738279c-33c3-43cd-9658-3ba25a1c3c1f None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.905525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738279c-33c3-43cd-9658-3ba25a1c3c1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.907567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738279c-33c3-43cd-9658-3ba25a1c3c1f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.908075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b956ac-916a-4088-a572-f77281628ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.909621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b956ac-916a-4088-a572-f77281628ea7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-34b956ac-916a-4088-a572-f77281628ea7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:27.922839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:27.926919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 385/740] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a76255-8ce3-45de-bc79-94117e6d1356 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.928282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a76255-8ce3-45de-bc79-94117e6d1356 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.929556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a76255-8ce3-45de-bc79-94117e6d1356 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.929556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 386/741] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:27.929556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a76255-8ce3-45de-bc79-94117e6d1356 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.021882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 356/742] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 10:59:27 2022] POST /identity/v3/services => generated 251 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:28.022810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738279c-33c3-43cd-9658-3ba25a1c3c1f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.061721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:28.068542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a76255-8ce3-45de-bc79-94117e6d1356 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.124185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aa0d3-e277-4009-95f2-3345df06a6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.124947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aa0d3-e277-4009-95f2-3345df06a6bf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.125227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aa0d3-e277-4009-95f2-3345df06a6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.125500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aa0d3-e277-4009-95f2-3345df06a6bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.133809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aa0d3-e277-4009-95f2-3345df06a6bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.135311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aa0d3-e277-4009-95f2-3345df06a6bf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.137518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1b8aa0d3-e277-4009-95f2-3345df06a6bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:28.149378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:28.151015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 387/743] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc991-e958-422d-b641-eba6fb85bffa None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.153412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc991-e958-422d-b641-eba6fb85bffa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.154510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc991-e958-422d-b641-eba6fb85bffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.177334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-aa0dc991-e958-422d-b641-eba6fb85bffa None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:28.177583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738279c-33c3-43cd-9658-3ba25a1c3c1f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.178580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-aa0dc991-e958-422d-b641-eba6fb85bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:28.239717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d675fc-fd3d-424a-af53-0a8e466f986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.240386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d675fc-fd3d-424a-af53-0a8e466f986b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.240662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d675fc-fd3d-424a-af53-0a8e466f986b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.240937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d675fc-fd3d-424a-af53-0a8e466f986b None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.241685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d675fc-fd3d-424a-af53-0a8e466f986b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:28.241990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d675fc-fd3d-424a-af53-0a8e466f986b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.243437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d675fc-fd3d-424a-af53-0a8e466f986b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.264254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 357/744] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Aug 31 10:59:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:28.265409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d675fc-fd3d-424a-af53-0a8e466f986b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.298938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 388/745] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:28.298938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc991-e958-422d-b641-eba6fb85bffa None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.392199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:28.408437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d675fc-fd3d-424a-af53-0a8e466f986b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.455944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b26c05-ef37-45b2-bf70-c4afa0bfffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.456604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b26c05-ef37-45b2-bf70-c4afa0bfffba None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.456889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b26c05-ef37-45b2-bf70-c4afa0bfffba None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.457191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b26c05-ef37-45b2-bf70-c4afa0bfffba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.466792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dc991-e958-422d-b641-eba6fb85bffa None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.476747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b26c05-ef37-45b2-bf70-c4afa0bfffba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-72b26c05-ef37-45b2-bf70-c4afa0bfffba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:28.482135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:28.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:28.484907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:28.492110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 358/746] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:28.493411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b26c05-ef37-45b2-bf70-c4afa0bfffba None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.509495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:28.519561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a67d1b-4931-4337-8ab8-2e5c6f781dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.520793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a67d1b-4931-4337-8ab8-2e5c6f781dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.521071 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a67d1b-4931-4337-8ab8-2e5c6f781dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.529146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a67d1b-4931-4337-8ab8-2e5c6f781dc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.529146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a67d1b-4931-4337-8ab8-2e5c6f781dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:28.529146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a67d1b-4931-4337-8ab8-2e5c6f781dc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.529146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a67d1b-4931-4337-8ab8-2e5c6f781dc4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.539884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 389/747] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:28.540505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a67d1b-4931-4337-8ab8-2e5c6f781dc4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.634254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b26c05-ef37-45b2-bf70-c4afa0bfffba None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.668636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a67d1b-4931-4337-8ab8-2e5c6f781dc4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.678659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f386e6-4176-4205-8f8a-896e54b60654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.679964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f386e6-4176-4205-8f8a-896e54b60654 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.680461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f386e6-4176-4205-8f8a-896e54b60654 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.681141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f386e6-4176-4205-8f8a-896e54b60654 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.705077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:28.707993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13978-7f16-4c4b-a299-ccf72bfebb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.709399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13978-7f16-4c4b-a299-ccf72bfebb39 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.710022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13978-7f16-4c4b-a299-ccf72bfebb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.710304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13978-7f16-4c4b-a299-ccf72bfebb39 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.710993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13978-7f16-4c4b-a299-ccf72bfebb39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:28.711456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13978-7f16-4c4b-a299-ccf72bfebb39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.713628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13978-7f16-4c4b-a299-ccf72bfebb39 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.725761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 390/748] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:28.725761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13978-7f16-4c4b-a299-ccf72bfebb39 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.766655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f386e6-4176-4205-8f8a-896e54b60654 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.768143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f386e6-4176-4205-8f8a-896e54b60654 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.787991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:28.857337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13978-7f16-4c4b-a299-ccf72bfebb39 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.882459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 359/749] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:28 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:28.884118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f386e6-4176-4205-8f8a-896e54b60654 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.902857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f8f25-7e3d-4d5f-a9d1-e3fc68d2f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.903930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f8f25-7e3d-4d5f-a9d1-e3fc68d2f81a None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.904408 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f8f25-7e3d-4d5f-a9d1-e3fc68d2f81a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.904914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f8f25-7e3d-4d5f-a9d1-e3fc68d2f81a None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/c9c5d8bbcf07486ea3d3e26c81135d2f/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.907670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f8f25-7e3d-4d5f-a9d1-e3fc68d2f81a None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=c9c5d8bbcf07486ea3d3e26c81135d2f, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.909393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f8f25-7e3d-4d5f-a9d1-e3fc68d2f81a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.944638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:28.986305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 391/750] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:59:28 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/c9c5d8bbcf07486ea3d3e26c81135d2f/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:28.987425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f8f25-7e3d-4d5f-a9d1-e3fc68d2f81a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.014125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f386e6-4176-4205-8f8a-896e54b60654 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.061685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269a2ce-9e9d-4ca0-9452-f9f92fe68ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:29.063389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a2ce-9e9d-4ca0-9452-f9f92fe68ff3 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:29.063739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a2ce-9e9d-4ca0-9452-f9f92fe68ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:29.064057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a2ce-9e9d-4ca0-9452-f9f92fe68ff3 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:29.064838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269a2ce-9e9d-4ca0-9452-f9f92fe68ff3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:29.066333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269a2ce-9e9d-4ca0-9452-f9f92fe68ff3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:29.148187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 360/751] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 10:59:28 2022] POST /identity/v3/services => generated 240 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:29.149120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269a2ce-9e9d-4ca0-9452-f9f92fe68ff3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.156822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f8f25-7e3d-4d5f-a9d1-e3fc68d2f81a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.172802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:29.223056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a4d5a-472e-4cc7-95b7-ba3324b24114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:29.223803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a4d5a-472e-4cc7-95b7-ba3324b24114 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:29.224087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a4d5a-472e-4cc7-95b7-ba3324b24114 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:29.224398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a4d5a-472e-4cc7-95b7-ba3324b24114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:29.240356 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a4d5a-472e-4cc7-95b7-ba3324b24114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:29.241884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a4d5a-472e-4cc7-95b7-ba3324b24114 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ef9a4d5a-472e-4cc7-95b7-ba3324b24114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:29.264760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:29.266340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:29.267474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:29.267474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:29.267474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:29.267474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 392/752] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:29.274321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a4d5a-472e-4cc7-95b7-ba3324b24114 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.321303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269a2ce-9e9d-4ca0-9452-f9f92fe68ff3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.348008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:29.390974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48864973-7c24-4dcc-a838-c838b3248ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:29.392820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48864973-7c24-4dcc-a838-c838b3248ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:29.393270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48864973-7c24-4dcc-a838-c838b3248ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:29.393688 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48864973-7c24-4dcc-a838-c838b3248ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:29.412318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48864973-7c24-4dcc-a838-c838b3248ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:29.414215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48864973-7c24-4dcc-a838-c838b3248ba6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-48864973-7c24-4dcc-a838-c838b3248ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:29.438410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:29.439597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:29.440725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:29.440725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:29.440725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:29.441053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 361/753] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:29.447199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48864973-7c24-4dcc-a838-c838b3248ba6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.462097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a4d5a-472e-4cc7-95b7-ba3324b24114 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.523409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d92f-b17c-4080-9634-437f2e98caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:29.524494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d92f-b17c-4080-9634-437f2e98caca None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:29.525150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d92f-b17c-4080-9634-437f2e98caca None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:29.525655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d92f-b17c-4080-9634-437f2e98caca None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:29.526512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d92f-b17c-4080-9634-437f2e98caca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:29.527148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d92f-b17c-4080-9634-437f2e98caca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:29.529080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d92f-b17c-4080-9634-437f2e98caca None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:29.550323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 393/754] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:29.559085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d92f-b17c-4080-9634-437f2e98caca None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.599444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:29.636275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48864973-7c24-4dcc-a838-c838b3248ba6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.740745 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3fc0-3f0b-4961-8aea-704dd9505aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:29.741792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3fc0-3f0b-4961-8aea-704dd9505aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:29.742300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3fc0-3f0b-4961-8aea-704dd9505aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:29.742797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3fc0-3f0b-4961-8aea-704dd9505aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:29.743664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e3fc0-3f0b-4961-8aea-704dd9505aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:29.744268 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e3fc0-3f0b-4961-8aea-704dd9505aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:29.745863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e3fc0-3f0b-4961-8aea-704dd9505aa6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:29.769620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d92f-b17c-4080-9634-437f2e98caca None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.773448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 362/755] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:29.790909 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3fc0-3f0b-4961-8aea-704dd9505aa6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.829476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615318e2-3f7f-434b-92fb-3d903032f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:29.830062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615318e2-3f7f-434b-92fb-3d903032f4bf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:29.830344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615318e2-3f7f-434b-92fb-3d903032f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:29.830611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615318e2-3f7f-434b-92fb-3d903032f4bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:29.832060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:29.845248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615318e2-3f7f-434b-92fb-3d903032f4bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:29.846609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615318e2-3f7f-434b-92fb-3d903032f4bf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-615318e2-3f7f-434b-92fb-3d903032f4bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:29.869714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:29.870852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:29.872636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 394/756] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:29.879889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615318e2-3f7f-434b-92fb-3d903032f4bf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.969189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3fc0-3f0b-4961-8aea-704dd9505aa6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.980481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.003822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615318e2-3f7f-434b-92fb-3d903032f4bf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.041264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde516f6-b815-475d-b8c3-8435692a46e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.041885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde516f6-b815-475d-b8c3-8435692a46e5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.042160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde516f6-b815-475d-b8c3-8435692a46e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.042431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde516f6-b815-475d-b8c3-8435692a46e5 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.043175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde516f6-b815-475d-b8c3-8435692a46e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:30.043481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde516f6-b815-475d-b8c3-8435692a46e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.045044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde516f6-b815-475d-b8c3-8435692a46e5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.066217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 395/757] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Aug 31 10:59:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:30.074722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde516f6-b815-475d-b8c3-8435692a46e5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.116527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5cb4e-821c-424d-820f-33ee8a94f72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.119152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5cb4e-821c-424d-820f-33ee8a94f72d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.120099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5cb4e-821c-424d-820f-33ee8a94f72d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.120592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5cb4e-821c-424d-820f-33ee8a94f72d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.128757 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5cb4e-821c-424d-820f-33ee8a94f72d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.130551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5cb4e-821c-424d-820f-33ee8a94f72d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-2cc5cb4e-821c-424d-820f-33ee8a94f72d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:30.143641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:30.144759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:30.145649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:30.145649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:30.145649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:30.145649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:30.145649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:30.145649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:30.145649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:30.145649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:30.148016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 363/758] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:30.149507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af167b-b93c-4793-9054-702c671e62df None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.150077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af167b-b93c-4793-9054-702c671e62df None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.150558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af167b-b93c-4793-9054-702c671e62df None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.157491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 364/759] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:30.158738 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af167b-b93c-4793-9054-702c671e62df None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.202612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde516f6-b815-475d-b8c3-8435692a46e5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.243737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff897-08d0-4c94-bd2b-10cd199b7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.244374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff897-08d0-4c94-bd2b-10cd199b7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.244649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff897-08d0-4c94-bd2b-10cd199b7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.244924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff897-08d0-4c94-bd2b-10cd199b7ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.249443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.279026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.298986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af167b-b93c-4793-9054-702c671e62df None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.344806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3d57f-bbf3-4200-a446-d8ed591b1536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.345547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d57f-bbf3-4200-a446-d8ed591b1536 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.345831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d57f-bbf3-4200-a446-d8ed591b1536 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.346151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d57f-bbf3-4200-a446-d8ed591b1536 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.347423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3d57f-bbf3-4200-a446-d8ed591b1536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:30.347734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3d57f-bbf3-4200-a446-d8ed591b1536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.349363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff897-08d0-4c94-bd2b-10cd199b7ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.349484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3d57f-bbf3-4200-a446-d8ed591b1536 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.351373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff897-08d0-4c94-bd2b-10cd199b7ea8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.371228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 365/760] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:30.373226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f95e-7fcd-4d3b-98ec-096131de782e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.373506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f95e-7fcd-4d3b-98ec-096131de782e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.373777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f95e-7fcd-4d3b-98ec-096131de782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.393607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4069f95e-7fcd-4d3b-98ec-096131de782e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:30.394697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4069f95e-7fcd-4d3b-98ec-096131de782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.484648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 366/761] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:30.486120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069f95e-7fcd-4d3b-98ec-096131de782e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.495900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 396/762] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:59:30.497313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff897-08d0-4c94-bd2b-10cd199b7ea8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.547199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.625424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.681513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff897-08d0-4c94-bd2b-10cd199b7ea8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.687718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069f95e-7fcd-4d3b-98ec-096131de782e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.763853 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aeefe-e2f5-443d-9c97-e73f3455fafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.764505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aeefe-e2f5-443d-9c97-e73f3455fafb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.764784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aeefe-e2f5-443d-9c97-e73f3455fafb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.765063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aeefe-e2f5-443d-9c97-e73f3455fafb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.770556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e9fdd-2221-43e2-baa6-6d41cffe2838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.771592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e9fdd-2221-43e2-baa6-6d41cffe2838 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.773561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e9fdd-2221-43e2-baa6-6d41cffe2838 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.773930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e9fdd-2221-43e2-baa6-6d41cffe2838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.774696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e9fdd-2221-43e2-baa6-6d41cffe2838 None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=623fd6adf2af4122a5a507efb4e0cbce) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:30.775022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e9fdd-2221-43e2-baa6-6d41cffe2838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.776505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e9fdd-2221-43e2-baa6-6d41cffe2838 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.791880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 367/763] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/role_assignments?user.id=623fd6adf2af4122a5a507efb4e0cbce&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:30.794624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0aeefe-e2f5-443d-9c97-e73f3455fafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.796233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0aeefe-e2f5-443d-9c97-e73f3455fafb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.809074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e9fdd-2221-43e2-baa6-6d41cffe2838 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fd0aeefe-e2f5-443d-9c97-e73f3455fafb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:30.818480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:30.819491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:30.820418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:30.820418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:30.820418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:30.820418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 397/764] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:30.829644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aeefe-e2f5-443d-9c97-e73f3455fafb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.005657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e9fdd-2221-43e2-baa6-6d41cffe2838 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.032456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.049596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aeefe-e2f5-443d-9c97-e73f3455fafb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.058831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb8ff-d523-4ac1-9623-5a412d26b11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.062314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb8ff-d523-4ac1-9623-5a412d26b11a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.062314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb8ff-d523-4ac1-9623-5a412d26b11a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.062314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb8ff-d523-4ac1-9623-5a412d26b11a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.062314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cb8ff-d523-4ac1-9623-5a412d26b11a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.063842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cb8ff-d523-4ac1-9623-5a412d26b11a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.067927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d31cb8ff-d523-4ac1-9623-5a412d26b11a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:31.079820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:31.081549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:31.082460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 368/765] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:31.083393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb8ff-d523-4ac1-9623-5a412d26b11a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.120933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b8315-9fcb-424d-98d2-9cc4c596b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.121607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b8315-9fcb-424d-98d2-9cc4c596b80b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.121883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b8315-9fcb-424d-98d2-9cc4c596b80b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.122120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b8315-9fcb-424d-98d2-9cc4c596b80b None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.122758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b8315-9fcb-424d-98d2-9cc4c596b80b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:31.123062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b8315-9fcb-424d-98d2-9cc4c596b80b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.124481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b8315-9fcb-424d-98d2-9cc4c596b80b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.158209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 398/766] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:31.164743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b8315-9fcb-424d-98d2-9cc4c596b80b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.291238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b8315-9fcb-424d-98d2-9cc4c596b80b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.332276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52faa18-bc4a-458c-bd64-2686b0034760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.333129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52faa18-bc4a-458c-bd64-2686b0034760 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.333578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52faa18-bc4a-458c-bd64-2686b0034760 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.334204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52faa18-bc4a-458c-bd64-2686b0034760 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.345169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52faa18-bc4a-458c-bd64-2686b0034760 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.346719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52faa18-bc4a-458c-bd64-2686b0034760 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a52faa18-bc4a-458c-bd64-2686b0034760 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:31.360343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:31.361371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:31.362272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:31.362272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:31.362272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:31.362272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:31.362272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:31.362272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:31.362272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:31.362272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:31.362272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 399/767] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:31.368767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52faa18-bc4a-458c-bd64-2686b0034760 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.387583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb8ff-d523-4ac1-9623-5a412d26b11a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.394078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.466785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade5b4f-ea89-4190-a3fb-bb7190ead7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.468051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade5b4f-ea89-4190-a3fb-bb7190ead7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.469127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade5b4f-ea89-4190-a3fb-bb7190ead7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.469628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade5b4f-ea89-4190-a3fb-bb7190ead7e1 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.470490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade5b4f-ea89-4190-a3fb-bb7190ead7e1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:31.471053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade5b4f-ea89-4190-a3fb-bb7190ead7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.477870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade5b4f-ea89-4190-a3fb-bb7190ead7e1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.488928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 369/768] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:31.494079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade5b4f-ea89-4190-a3fb-bb7190ead7e1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.526854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52faa18-bc4a-458c-bd64-2686b0034760 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.566781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1734c-7b81-437e-9339-d5bfb767b05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.567468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1734c-7b81-437e-9339-d5bfb767b05b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.567896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1734c-7b81-437e-9339-d5bfb767b05b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.568159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1734c-7b81-437e-9339-d5bfb767b05b None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.568869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1734c-7b81-437e-9339-d5bfb767b05b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:31.569173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1734c-7b81-437e-9339-d5bfb767b05b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.570626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1734c-7b81-437e-9339-d5bfb767b05b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.588441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 400/769] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:31.591789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e8ee0-20bd-462d-854b-9e7392420106 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.591789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e8ee0-20bd-462d-854b-9e7392420106 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.591789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e8ee0-20bd-462d-854b-9e7392420106 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.592212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 401/770] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:31.598405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e7c1e-fc0c-4597-ad33-f8c7f0261d0e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.598720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e7c1e-fc0c-4597-ad33-f8c7f0261d0e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.598963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e7c1e-fc0c-4597-ad33-f8c7f0261d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.620552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2c7e7c1e-fc0c-4597-ad33-f8c7f0261d0e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:31.622485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2c7e7c1e-fc0c-4597-ad33-f8c7f0261d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.656584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.708704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.721567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 402/771] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:31.723370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e7c1e-fc0c-4597-ad33-f8c7f0261d0e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.728286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade5b4f-ea89-4190-a3fb-bb7190ead7e1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.777239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f250f-a51c-4734-b3b0-b3468fe1fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.777895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f250f-a51c-4734-b3b0-b3468fe1fc60 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.778907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f250f-a51c-4734-b3b0-b3468fe1fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.778907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f250f-a51c-4734-b3b0-b3468fe1fc60 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.779367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f250f-a51c-4734-b3b0-b3468fe1fc60 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:31.779739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f250f-a51c-4734-b3b0-b3468fe1fc60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.781955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f250f-a51c-4734-b3b0-b3468fe1fc60 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.794749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 370/772] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:31.796217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6a7a2-0787-475b-815b-4675c6c5750e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.797481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6a7a2-0787-475b-815b-4675c6c5750e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.797759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6a7a2-0787-475b-815b-4675c6c5750e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.799360 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 371/773] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:31.800255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6a7a2-0787-475b-815b-4675c6c5750e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.857622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e7c1e-fc0c-4597-ad33-f8c7f0261d0e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.897043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154a6a7-ed4e-417c-a771-e5ccc58ecb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.898002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154a6a7-ed4e-417c-a771-e5ccc58ecb72 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.898524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154a6a7-ed4e-417c-a771-e5ccc58ecb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.899163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154a6a7-ed4e-417c-a771-e5ccc58ecb72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.900811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154a6a7-ed4e-417c-a771-e5ccc58ecb72 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=62c91e3eec414a5189befb91012955c2) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:31.901539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154a6a7-ed4e-417c-a771-e5ccc58ecb72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.904105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154a6a7-ed4e-417c-a771-e5ccc58ecb72 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.911178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 403/774] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/role_assignments?user.id=62c91e3eec414a5189befb91012955c2&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=55aed406476a485f99f9815f9f27cb3b => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:31.912874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373c6a0-b46a-4b8e-920d-12c577cb8833 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.913377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373c6a0-b46a-4b8e-920d-12c577cb8833 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.913860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373c6a0-b46a-4b8e-920d-12c577cb8833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.916636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6a7a2-0787-475b-815b-4675c6c5750e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.942145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4373c6a0-b46a-4b8e-920d-12c577cb8833 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:31.944000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4373c6a0-b46a-4b8e-920d-12c577cb8833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.948046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.957153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0655d-de94-4b0c-8e88-ca53362009c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.961538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0655d-de94-4b0c-8e88-ca53362009c6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.961538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0655d-de94-4b0c-8e88-ca53362009c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.961538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0655d-de94-4b0c-8e88-ca53362009c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.961538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0655d-de94-4b0c-8e88-ca53362009c6 None admin] RBAC: Adding query filter params (interface=public, service_id=e5dc777aee3d43ff8e48c0668ce731cd, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:31.961538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0655d-de94-4b0c-8e88-ca53362009c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.961538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0655d-de94-4b0c-8e88-ca53362009c6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.972786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 372/775] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/endpoints?service_id=e5dc777aee3d43ff8e48c0668ce731cd&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:31.979037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0655d-de94-4b0c-8e88-ca53362009c6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.015799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:32.027724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 404/776] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:32.117966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373c6a0-b46a-4b8e-920d-12c577cb8833 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.128329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0655d-de94-4b0c-8e88-ca53362009c6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.179638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cac4c5-960a-40e6-8228-c1fb5dfb3372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.180281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cac4c5-960a-40e6-8228-c1fb5dfb3372 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.180562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cac4c5-960a-40e6-8228-c1fb5dfb3372 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.180830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cac4c5-960a-40e6-8228-c1fb5dfb3372 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.181452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cac4c5-960a-40e6-8228-c1fb5dfb3372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.182856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cac4c5-960a-40e6-8228-c1fb5dfb3372 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.189932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 373/777] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:32.299469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373c6a0-b46a-4b8e-920d-12c577cb8833 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.379162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8454f-9263-46f3-8006-553692518cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.380175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8454f-9263-46f3-8006-553692518cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.380636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8454f-9263-46f3-8006-553692518cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.381066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8454f-9263-46f3-8006-553692518cc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.387125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cac4c5-960a-40e6-8228-c1fb5dfb3372 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.399604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8454f-9263-46f3-8006-553692518cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a7a8454f-9263-46f3-8006-553692518cc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:32.408218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:32.410281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:32.412190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:32.422533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 405/778] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:32.430209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8454f-9263-46f3-8006-553692518cc5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.473050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:32.521310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cac4c5-960a-40e6-8228-c1fb5dfb3372 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.532841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:32.560327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcf4d-cf12-44e4-952e-f625f171fba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.560967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcf4d-cf12-44e4-952e-f625f171fba6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.561243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcf4d-cf12-44e4-952e-f625f171fba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcf4d-cf12-44e4-952e-f625f171fba6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.562136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfcf4d-cf12-44e4-952e-f625f171fba6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.563532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfcf4d-cf12-44e4-952e-f625f171fba6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-55bfcf4d-cf12-44e4-952e-f625f171fba6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:32.572950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:32.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:32.575263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 374/779] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:32.580487 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcf4d-cf12-44e4-952e-f625f171fba6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.589569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8454f-9263-46f3-8006-553692518cc5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.634544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0de8f-5029-49aa-819e-84090d13e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.635090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0de8f-5029-49aa-819e-84090d13e688 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.635430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0de8f-5029-49aa-819e-84090d13e688 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.635709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0de8f-5029-49aa-819e-84090d13e688 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.636523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0de8f-5029-49aa-819e-84090d13e688 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:32.636833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0de8f-5029-49aa-819e-84090d13e688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.638402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0de8f-5029-49aa-819e-84090d13e688 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.653187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 406/780] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:32.656000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0de8f-5029-49aa-819e-84090d13e688 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.695794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcf4d-cf12-44e4-952e-f625f171fba6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.717630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:32.738016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79100-1ca2-41b7-b0a3-1478f42ebe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.738897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79100-1ca2-41b7-b0a3-1478f42ebe4b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.741611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79100-1ca2-41b7-b0a3-1478f42ebe4b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.741611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b79100-1ca2-41b7-b0a3-1478f42ebe4b None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.741611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b79100-1ca2-41b7-b0a3-1478f42ebe4b None admin] RBAC: Adding query filter params (name=network) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:32.741611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b79100-1ca2-41b7-b0a3-1478f42ebe4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.743208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b79100-1ca2-41b7-b0a3-1478f42ebe4b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.751282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 375/781] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:32.761415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79100-1ca2-41b7-b0a3-1478f42ebe4b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.786349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0de8f-5029-49aa-819e-84090d13e688 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.805027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:32.832322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cc4b2-0f31-4c5d-ae23-c49adf9705e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.833361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cc4b2-0f31-4c5d-ae23-c49adf9705e8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.833860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cc4b2-0f31-4c5d-ae23-c49adf9705e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.834356 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cc4b2-0f31-4c5d-ae23-c49adf9705e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.847580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cc4b2-0f31-4c5d-ae23-c49adf9705e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.849486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cc4b2-0f31-4c5d-ae23-c49adf9705e8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f07cc4b2-0f31-4c5d-ae23-c49adf9705e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:32.866465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:32.867499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:32.868430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:32.868430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:32.868430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:32.870776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 407/782] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:32.876896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cc4b2-0f31-4c5d-ae23-c49adf9705e8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.006634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b79100-1ca2-41b7-b0a3-1478f42ebe4b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.060103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cc4b2-0f31-4c5d-ae23-c49adf9705e8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.104051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3147b-9fbf-443e-a662-2e9c6db9ce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.104481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18739721-297e-4a7d-999c-0ad57b441223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.105108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18739721-297e-4a7d-999c-0ad57b441223 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.105440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18739721-297e-4a7d-999c-0ad57b441223 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.105705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18739721-297e-4a7d-999c-0ad57b441223 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.106295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18739721-297e-4a7d-999c-0ad57b441223 None admin] RBAC: Adding query filter params (type=network) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:33.106597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18739721-297e-4a7d-999c-0ad57b441223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.107212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3147b-9fbf-443e-a662-2e9c6db9ce8b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.107994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18739721-297e-4a7d-999c-0ad57b441223 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.108283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3147b-9fbf-443e-a662-2e9c6db9ce8b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.109038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3147b-9fbf-443e-a662-2e9c6db9ce8b None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.110615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3147b-9fbf-443e-a662-2e9c6db9ce8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:33.111321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3147b-9fbf-443e-a662-2e9c6db9ce8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.115098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3147b-9fbf-443e-a662-2e9c6db9ce8b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.122295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 376/783] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:33.128247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18739721-297e-4a7d-999c-0ad57b441223 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.135660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 408/784] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:33.155378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3147b-9fbf-443e-a662-2e9c6db9ce8b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.207532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:33.267264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:33.326890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3147b-9fbf-443e-a662-2e9c6db9ce8b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.347269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18739721-297e-4a7d-999c-0ad57b441223 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.380410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e9986-5221-4868-be8b-5236c78cf9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.381216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9986-5221-4868-be8b-5236c78cf9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.381498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9986-5221-4868-be8b-5236c78cf9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.381756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9986-5221-4868-be8b-5236c78cf9b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.391885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e9986-5221-4868-be8b-5236c78cf9b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.393645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e9986-5221-4868-be8b-5236c78cf9b9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.395777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab35cb8-cb02-4c2d-ac97-f8d2ca2b7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.396723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab35cb8-cb02-4c2d-ac97-f8d2ca2b7e0c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.397195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab35cb8-cb02-4c2d-ac97-f8d2ca2b7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.397677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab35cb8-cb02-4c2d-ac97-f8d2ca2b7e0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.398585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab35cb8-cb02-4c2d-ac97-f8d2ca2b7e0c None admin] RBAC: Adding query filter params (interface=public, service_id=f8591a793a5448898f741405e511e985, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:33.399108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab35cb8-cb02-4c2d-ac97-f8d2ca2b7e0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.400677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab35cb8-cb02-4c2d-ac97-f8d2ca2b7e0c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fd4e9986-5221-4868-be8b-5236c78cf9b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:33.411394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:33.412425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 409/786] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900df10-d8e3-4ee9-81e2-5203bbc9a757 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.413364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900df10-d8e3-4ee9-81e2-5203bbc9a757 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.414086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900df10-d8e3-4ee9-81e2-5203bbc9a757 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.414086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 410/787] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:33.414086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900df10-d8e3-4ee9-81e2-5203bbc9a757 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.415054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 377/787] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/endpoints?service_id=f8591a793a5448898f741405e511e985&interface=public®ion_id=RegionOne => generated 194 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:33.416461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab35cb8-cb02-4c2d-ac97-f8d2ca2b7e0c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.533317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:33.549405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab35cb8-cb02-4c2d-ac97-f8d2ca2b7e0c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.555675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900df10-d8e3-4ee9-81e2-5203bbc9a757 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.566431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:33.592044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d0e11-c7b1-4b55-a74d-4eef2f9ed573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.593073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d0e11-c7b1-4b55-a74d-4eef2f9ed573 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.594121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d0e11-c7b1-4b55-a74d-4eef2f9ed573 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.595890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d0e11-c7b1-4b55-a74d-4eef2f9ed573 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.597168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d0e11-c7b1-4b55-a74d-4eef2f9ed573 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:33.597727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d0e11-c7b1-4b55-a74d-4eef2f9ed573 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.599652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d0e11-c7b1-4b55-a74d-4eef2f9ed573 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.615873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee1bb-934e-49ba-90b7-7f273eae6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.616495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee1bb-934e-49ba-90b7-7f273eae6432 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.616773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee1bb-934e-49ba-90b7-7f273eae6432 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.617038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ee1bb-934e-49ba-90b7-7f273eae6432 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.617648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ee1bb-934e-49ba-90b7-7f273eae6432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.619141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ee1bb-934e-49ba-90b7-7f273eae6432 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.625682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 378/788] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:33.627412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dd4e1-3f76-4dfd-9c91-cb1bc6612dc3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.628039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dd4e1-3f76-4dfd-9c91-cb1bc6612dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.628571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dd4e1-3f76-4dfd-9c91-cb1bc6612dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.632013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 411/789] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:33.633358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee1bb-934e-49ba-90b7-7f273eae6432 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.786421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-680dd4e1-3f76-4dfd-9c91-cb1bc6612dc3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:33.788040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-680dd4e1-3f76-4dfd-9c91-cb1bc6612dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:33.867731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ee1bb-934e-49ba-90b7-7f273eae6432 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.881610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 379/790] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:33.907626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5499b-6660-404e-a78e-0ab6b30f510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.908274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5499b-6660-404e-a78e-0ab6b30f510b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.908812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5499b-6660-404e-a78e-0ab6b30f510b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.909112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5499b-6660-404e-a78e-0ab6b30f510b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.931130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:33.985617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5499b-6660-404e-a78e-0ab6b30f510b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.987158 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5499b-6660-404e-a78e-0ab6b30f510b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.102227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 412/791] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:34.107664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dd4e1-3f76-4dfd-9c91-cb1bc6612dc3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.245783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5499b-6660-404e-a78e-0ab6b30f510b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.256977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:34.260981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dd4e1-3f76-4dfd-9c91-cb1bc6612dc3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.301902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3bfe0-7188-44cc-b52e-2828ade3b36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.302567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3bfe0-7188-44cc-b52e-2828ade3b36f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.302810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3bfe0-7188-44cc-b52e-2828ade3b36f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.303078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3bfe0-7188-44cc-b52e-2828ade3b36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.315683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3bfe0-7188-44cc-b52e-2828ade3b36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.317244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3bfe0-7188-44cc-b52e-2828ade3b36f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d7c3bfe0-7188-44cc-b52e-2828ade3b36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:34.334146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:34.335134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:34.336286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:34.336286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:34.336286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:34.336286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 380/792] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:34.342846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3bfe0-7188-44cc-b52e-2828ade3b36f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.397320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:34.494178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3bfe0-7188-44cc-b52e-2828ade3b36f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.538879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5499b-6660-404e-a78e-0ab6b30f510b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.547040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283da59-bbf9-48f6-a6f7-22ead4d4326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.548415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283da59-bbf9-48f6-a6f7-22ead4d4326f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.549153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283da59-bbf9-48f6-a6f7-22ead4d4326f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.549842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283da59-bbf9-48f6-a6f7-22ead4d4326f None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.551227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283da59-bbf9-48f6-a6f7-22ead4d4326f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:34.552000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283da59-bbf9-48f6-a6f7-22ead4d4326f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.554735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283da59-bbf9-48f6-a6f7-22ead4d4326f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.574595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 381/793] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:34.587982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283da59-bbf9-48f6-a6f7-22ead4d4326f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.618127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cceda-5423-419b-9247-265f77e62acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.619873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cceda-5423-419b-9247-265f77e62acc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.620620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cceda-5423-419b-9247-265f77e62acc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.621154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cceda-5423-419b-9247-265f77e62acc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.628583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:34.643936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cceda-5423-419b-9247-265f77e62acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1d5cceda-5423-419b-9247-265f77e62acc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:34.651107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:34.652103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:34.652939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:34.656249 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 413/794] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:34.661744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cceda-5423-419b-9247-265f77e62acc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.794481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283da59-bbf9-48f6-a6f7-22ead4d4326f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.821849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cceda-5423-419b-9247-265f77e62acc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.834078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:34.841660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0611e-7ee9-498f-907d-9a72a2f435c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.849330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0611e-7ee9-498f-907d-9a72a2f435c4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.849330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0611e-7ee9-498f-907d-9a72a2f435c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.849330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0611e-7ee9-498f-907d-9a72a2f435c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.851460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0611e-7ee9-498f-907d-9a72a2f435c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.852983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0611e-7ee9-498f-907d-9a72a2f435c4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.862354 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46852e-303f-448e-972c-0ea817491116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.863024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46852e-303f-448e-972c-0ea817491116 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.863722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46852e-303f-448e-972c-0ea817491116 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.866363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46852e-303f-448e-972c-0ea817491116 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.866363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46852e-303f-448e-972c-0ea817491116 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:34.866363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46852e-303f-448e-972c-0ea817491116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-9ae0611e-7ee9-498f-907d-9a72a2f435c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:34.866697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:34.867635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:34.868737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:34.868737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:34.868737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:34.868737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:34.868737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:34.868737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:34.868737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:34.868737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:34.869168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46852e-303f-448e-972c-0ea817491116 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.869249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 382/795] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:34.869249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac514427-2528-4801-b8ad-f4f07bf5aa4f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.869249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac514427-2528-4801-b8ad-f4f07bf5aa4f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.869249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac514427-2528-4801-b8ad-f4f07bf5aa4f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.870251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 383/796] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:34.870922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075574b-6eb8-4908-8e2d-054d58c7f8b4 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.871193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075574b-6eb8-4908-8e2d-054d58c7f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.871532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075574b-6eb8-4908-8e2d-054d58c7f8b4 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.876431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 384/797] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:34.876431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075574b-6eb8-4908-8e2d-054d58c7f8b4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.883306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 414/798] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:34.884829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d394f-9673-4ad1-aa94-db97a68a35e1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.885281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d394f-9673-4ad1-aa94-db97a68a35e1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.885709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d394f-9673-4ad1-aa94-db97a68a35e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.905495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e38d394f-9673-4ad1-aa94-db97a68a35e1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:34.907601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e38d394f-9673-4ad1-aa94-db97a68a35e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:35.019779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 415/799] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:35.019779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f592b-ee1c-458b-ab9b-cda30a6feeb2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.019779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f592b-ee1c-458b-ab9b-cda30a6feeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.019779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f592b-ee1c-458b-ab9b-cda30a6feeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.036739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:35.040417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ec0f592b-ee1c-458b-ab9b-cda30a6feeb2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:35.041623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ec0f592b-ee1c-458b-ab9b-cda30a6feeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:35.078206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075574b-6eb8-4908-8e2d-054d58c7f8b4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.115506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd9251-d92d-4607-b5e6-2ae49dd0a4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.116145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9251-d92d-4607-b5e6-2ae49dd0a4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.116420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9251-d92d-4607-b5e6-2ae49dd0a4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.116687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9251-d92d-4607-b5e6-2ae49dd0a4f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.117380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd9251-d92d-4607-b5e6-2ae49dd0a4f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:35.117678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd9251-d92d-4607-b5e6-2ae49dd0a4f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.119110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd9251-d92d-4607-b5e6-2ae49dd0a4f4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.134121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 385/800] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:35.135082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd9251-d92d-4607-b5e6-2ae49dd0a4f4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.152345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 416/801] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:35.153217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f592b-ee1c-458b-ab9b-cda30a6feeb2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.216209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:35.348243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd9251-d92d-4607-b5e6-2ae49dd0a4f4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.378501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f592b-ee1c-458b-ab9b-cda30a6feeb2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.398355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:35.404499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8396c8-0361-45d4-9f4a-c6bd881c5a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.405262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8396c8-0361-45d4-9f4a-c6bd881c5a34 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.405781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8396c8-0361-45d4-9f4a-c6bd881c5a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.406463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8396c8-0361-45d4-9f4a-c6bd881c5a34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.421950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8396c8-0361-45d4-9f4a-c6bd881c5a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.423969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8396c8-0361-45d4-9f4a-c6bd881c5a34 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.431340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77711-eda9-4441-bb9c-dbd98a9bd668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.432622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77711-eda9-4441-bb9c-dbd98a9bd668 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.433086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77711-eda9-4441-bb9c-dbd98a9bd668 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.434135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77711-eda9-4441-bb9c-dbd98a9bd668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.435076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77711-eda9-4441-bb9c-dbd98a9bd668 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=c9c5d8bbcf07486ea3d3e26c81135d2f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:35.436132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77711-eda9-4441-bb9c-dbd98a9bd668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.438137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77711-eda9-4441-bb9c-dbd98a9bd668 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3b8396c8-0361-45d4-9f4a-c6bd881c5a34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:35.443978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:35.445124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:35.446222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:35.446222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:35.446222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:35.453122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 386/802] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:35.453122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8396c8-0361-45d4-9f4a-c6bd881c5a34 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.453891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 417/803] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/role_assignments?user.id=c9c5d8bbcf07486ea3d3e26c81135d2f&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=55aed406476a485f99f9815f9f27cb3b => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:35.455097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77711-eda9-4441-bb9c-dbd98a9bd668 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.600948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8396c8-0361-45d4-9f4a-c6bd881c5a34 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.648290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4c9ab-878b-412a-9ce6-258776e61a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.648962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4c9ab-878b-412a-9ce6-258776e61a21 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.649894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4c9ab-878b-412a-9ce6-258776e61a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.649894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4c9ab-878b-412a-9ce6-258776e61a21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.671182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4c9ab-878b-412a-9ce6-258776e61a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-caa4c9ab-878b-412a-9ce6-258776e61a21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:35.677881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:35.679179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:35.680059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 387/804] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:35.680757 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4c9ab-878b-412a-9ce6-258776e61a21 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.773916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:35.790442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:35.797681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77711-eda9-4441-bb9c-dbd98a9bd668 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.805482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4c9ab-878b-412a-9ce6-258776e61a21 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.847939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab0f1-0891-41b3-92fc-63026993b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.848848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab0f1-0891-41b3-92fc-63026993b027 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.849222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab0f1-0891-41b3-92fc-63026993b027 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.849596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab0f1-0891-41b3-92fc-63026993b027 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.850362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ab0f1-0891-41b3-92fc-63026993b027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:35.850758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ab0f1-0891-41b3-92fc-63026993b027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.852358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ab0f1-0891-41b3-92fc-63026993b027 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.864352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199e9d-8bd3-4273-8b59-79876aad9cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.865497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199e9d-8bd3-4273-8b59-79876aad9cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.865830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199e9d-8bd3-4273-8b59-79876aad9cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.866139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199e9d-8bd3-4273-8b59-79876aad9cb2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.866886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb199e9d-8bd3-4273-8b59-79876aad9cb2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.867080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 418/805] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:35.868610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb199e9d-8bd3-4273-8b59-79876aad9cb2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.868739 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab0f1-0891-41b3-92fc-63026993b027 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-eb199e9d-8bd3-4273-8b59-79876aad9cb2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:35.880078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:35.881140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:35.881975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 388/806] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:35.882747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199e9d-8bd3-4273-8b59-79876aad9cb2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.995380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199e9d-8bd3-4273-8b59-79876aad9cb2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.000488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab0f1-0891-41b3-92fc-63026993b027 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.006239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:36.037648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70feb3-d922-4c36-8b67-30d81b246ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.038740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70feb3-d922-4c36-8b67-30d81b246ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.039266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70feb3-d922-4c36-8b67-30d81b246ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.039655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752476d-15eb-4375-b670-48c664ee2947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.039883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70feb3-d922-4c36-8b67-30d81b246ef8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.040438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752476d-15eb-4375-b670-48c664ee2947 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.040777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752476d-15eb-4375-b670-48c664ee2947 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.041105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752476d-15eb-4375-b670-48c664ee2947 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.041839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752476d-15eb-4375-b670-48c664ee2947 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:36.042202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752476d-15eb-4375-b670-48c664ee2947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.043650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752476d-15eb-4375-b670-48c664ee2947 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.050249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70feb3-d922-4c36-8b67-30d81b246ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.052120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70feb3-d922-4c36-8b67-30d81b246ef8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.055215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 419/807] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:36.059815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752476d-15eb-4375-b670-48c664ee2947 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-ea70feb3-d922-4c36-8b67-30d81b246ef8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:36.072775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:36.073814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:36.074750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:36.076396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 389/808] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:36.077992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70feb3-d922-4c36-8b67-30d81b246ef8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.088774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:36.189230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752476d-15eb-4375-b670-48c664ee2947 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.199475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70feb3-d922-4c36-8b67-30d81b246ef8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.229876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39a658-6258-430b-8a9b-ea71dbb67b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.230580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a658-6258-430b-8a9b-ea71dbb67b6e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.230916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a658-6258-430b-8a9b-ea71dbb67b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.231272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39a658-6258-430b-8a9b-ea71dbb67b6e None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.232025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39a658-6258-430b-8a9b-ea71dbb67b6e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:36.232389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39a658-6258-430b-8a9b-ea71dbb67b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.233875 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39a658-6258-430b-8a9b-ea71dbb67b6e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.238791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a7529-2a12-4476-b22e-19214cb59e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.239000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 420/809] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:36.243801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39a658-6258-430b-8a9b-ea71dbb67b6e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.244791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a7529-2a12-4476-b22e-19214cb59e6a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.245259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a7529-2a12-4476-b22e-19214cb59e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.245685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a7529-2a12-4476-b22e-19214cb59e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.259273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a7529-2a12-4476-b22e-19214cb59e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.261140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a7529-2a12-4476-b22e-19214cb59e6a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-016a7529-2a12-4476-b22e-19214cb59e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:36.284625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:36.285550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:36.286453 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:36.286453 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:36.286453 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:36.290570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 390/810] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:36.292247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f6f53-45b5-4ea6-b22e-517390685207 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.292247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f6f53-45b5-4ea6-b22e-517390685207 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.292483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f6f53-45b5-4ea6-b22e-517390685207 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.294029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 391/811] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:36.294737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f6f53-45b5-4ea6-b22e-517390685207 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.324017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:36.345462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:36.368286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39a658-6258-430b-8a9b-ea71dbb67b6e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.416147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a7c1f-5870-4671-9990-24fc2225eb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.416772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7c1f-5870-4671-9990-24fc2225eb6a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.417038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7c1f-5870-4671-9990-24fc2225eb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.417305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7c1f-5870-4671-9990-24fc2225eb6a None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.418038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a7c1f-5870-4671-9990-24fc2225eb6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:36.418340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a7c1f-5870-4671-9990-24fc2225eb6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.419792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a7c1f-5870-4671-9990-24fc2225eb6a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.434667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f6f53-45b5-4ea6-b22e-517390685207 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.445904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 421/812] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:36.446729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a7c1f-5870-4671-9990-24fc2225eb6a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.478354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0eea8-6831-46c2-9768-2204b0b366b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.478964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0eea8-6831-46c2-9768-2204b0b366b4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.479241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0eea8-6831-46c2-9768-2204b0b366b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.479511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0eea8-6831-46c2-9768-2204b0b366b4 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.480171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0eea8-6831-46c2-9768-2204b0b366b4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:36.480467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0eea8-6831-46c2-9768-2204b0b366b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.481833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0eea8-6831-46c2-9768-2204b0b366b4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.488283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 392/813] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:36.493981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0665b-7bc5-4994-94fa-3e9a12145130 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.494353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0665b-7bc5-4994-94fa-3e9a12145130 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.494700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0665b-7bc5-4994-94fa-3e9a12145130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.514205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6ea0665b-7bc5-4994-94fa-3e9a12145130 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:36.516000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6ea0665b-7bc5-4994-94fa-3e9a12145130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:36.589470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a7c1f-5870-4671-9990-24fc2225eb6a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.598366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 393/814] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:36.599380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0665b-7bc5-4994-94fa-3e9a12145130 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.616200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:36.639604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5e8c-8e55-4c76-9c91-234af1ddcf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.641601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5e8c-8e55-4c76-9c91-234af1ddcf74 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.642471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5e8c-8e55-4c76-9c91-234af1ddcf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.643240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5e8c-8e55-4c76-9c91-234af1ddcf74 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.644732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c5e8c-8e55-4c76-9c91-234af1ddcf74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:36.645910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c5e8c-8e55-4c76-9c91-234af1ddcf74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.648125 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c5e8c-8e55-4c76-9c91-234af1ddcf74 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.659356 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:36.667966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 422/815] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:36.669115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5e8c-8e55-4c76-9c91-234af1ddcf74 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.711389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0665b-7bc5-4994-94fa-3e9a12145130 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.752156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f9896-2b5e-417f-965a-ec93124a1af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.753101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f9896-2b5e-417f-965a-ec93124a1af2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.753584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f9896-2b5e-417f-965a-ec93124a1af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.754042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f9896-2b5e-417f-965a-ec93124a1af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.766501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f9896-2b5e-417f-965a-ec93124a1af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.768709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f9896-2b5e-417f-965a-ec93124a1af2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.791683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5e8c-8e55-4c76-9c91-234af1ddcf74 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e53f9896-2b5e-417f-965a-ec93124a1af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:36.793260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:36.794175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:36.795055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:36.795055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:36.795055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:36.795055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 394/816] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:36.795698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f9896-2b5e-417f-965a-ec93124a1af2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.835720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab17a62-65cf-48e0-aa2c-7d60e910c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.836602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab17a62-65cf-48e0-aa2c-7d60e910c629 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.836886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab17a62-65cf-48e0-aa2c-7d60e910c629 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.837150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab17a62-65cf-48e0-aa2c-7d60e910c629 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.837811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab17a62-65cf-48e0-aa2c-7d60e910c629 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.839949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab17a62-65cf-48e0-aa2c-7d60e910c629 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.886539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:36.925533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f9896-2b5e-417f-965a-ec93124a1af2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.950944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 423/817] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:36.952248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab17a62-65cf-48e0-aa2c-7d60e910c629 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.980622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063456b-a2a8-4a14-ad7b-538b7abd9153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.981841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063456b-a2a8-4a14-ad7b-538b7abd9153 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.983107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063456b-a2a8-4a14-ad7b-538b7abd9153 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.983387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063456b-a2a8-4a14-ad7b-538b7abd9153 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.994758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063456b-a2a8-4a14-ad7b-538b7abd9153 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.996549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063456b-a2a8-4a14-ad7b-538b7abd9153 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e063456b-a2a8-4a14-ad7b-538b7abd9153 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:37.014395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:37.016407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:37.017565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:37.021662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 395/818] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:37.022678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063456b-a2a8-4a14-ad7b-538b7abd9153 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.078213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:37.128606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab17a62-65cf-48e0-aa2c-7d60e910c629 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.168173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063456b-a2a8-4a14-ad7b-538b7abd9153 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.175873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6aaa-ff0f-40ab-a070-ea7f2a55ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.176503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6aaa-ff0f-40ab-a070-ea7f2a55ba6a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.176776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6aaa-ff0f-40ab-a070-ea7f2a55ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.177042 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6aaa-ff0f-40ab-a070-ea7f2a55ba6a None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.177693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f6aaa-ff0f-40ab-a070-ea7f2a55ba6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:37.177990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f6aaa-ff0f-40ab-a070-ea7f2a55ba6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:37.180228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f6aaa-ff0f-40ab-a070-ea7f2a55ba6a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.196417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 424/819] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:37.197690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6aaa-ff0f-40ab-a070-ea7f2a55ba6a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.204229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:37.221099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad32a63-1a89-4982-899b-c4a3ad59da3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.222023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad32a63-1a89-4982-899b-c4a3ad59da3e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.222309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad32a63-1a89-4982-899b-c4a3ad59da3e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.222584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad32a63-1a89-4982-899b-c4a3ad59da3e None admin] PATH_INFO: `/v3/services/network` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.223455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad32a63-1a89-4982-899b-c4a3ad59da3e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:37.225387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad32a63-1a89-4982-899b-c4a3ad59da3e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-0ad32a63-1a89-4982-899b-c4a3ad59da3e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:37.239549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:37.240695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:37.241898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 396/820] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:37 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:37.242696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad32a63-1a89-4982-899b-c4a3ad59da3e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.334204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6aaa-ff0f-40ab-a070-ea7f2a55ba6a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.367887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:37.372349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad32a63-1a89-4982-899b-c4a3ad59da3e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.381654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071efc8d-0eef-4757-8b4f-2e606f0a82fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.382726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071efc8d-0eef-4757-8b4f-2e606f0a82fb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.383284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071efc8d-0eef-4757-8b4f-2e606f0a82fb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.383796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071efc8d-0eef-4757-8b4f-2e606f0a82fb None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.384870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071efc8d-0eef-4757-8b4f-2e606f0a82fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:37.385406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071efc8d-0eef-4757-8b4f-2e606f0a82fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:37.387163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071efc8d-0eef-4757-8b4f-2e606f0a82fb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.408738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 425/821] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Aug 31 10:59:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:37.410147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071efc8d-0eef-4757-8b4f-2e606f0a82fb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.418312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46011064-ea5f-411e-acb7-21ca01d1662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.418953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46011064-ea5f-411e-acb7-21ca01d1662f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.419231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46011064-ea5f-411e-acb7-21ca01d1662f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.419512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46011064-ea5f-411e-acb7-21ca01d1662f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.429958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46011064-ea5f-411e-acb7-21ca01d1662f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:37.431952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46011064-ea5f-411e-acb7-21ca01d1662f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-46011064-ea5f-411e-acb7-21ca01d1662f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:37.447201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:37.449567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 397/822] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:37.451223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46011064-ea5f-411e-acb7-21ca01d1662f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.519153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:37.545701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071efc8d-0eef-4757-8b4f-2e606f0a82fb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.591686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681191ea-1163-4b0b-a69e-1ebb777ad486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.592897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681191ea-1163-4b0b-a69e-1ebb777ad486 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.593444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681191ea-1163-4b0b-a69e-1ebb777ad486 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.594350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681191ea-1163-4b0b-a69e-1ebb777ad486 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.595532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681191ea-1163-4b0b-a69e-1ebb777ad486 None admin] RBAC: Adding query filter params (name=network) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:37.596086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681191ea-1163-4b0b-a69e-1ebb777ad486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:37.597863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681191ea-1163-4b0b-a69e-1ebb777ad486 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.602595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46011064-ea5f-411e-acb7-21ca01d1662f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.608604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 426/823] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:37.610174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681191ea-1163-4b0b-a69e-1ebb777ad486 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.657761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2188-6a07-4f9f-9649-8a5f5961965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.658459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2188-6a07-4f9f-9649-8a5f5961965d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.658740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2188-6a07-4f9f-9649-8a5f5961965d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.659009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2188-6a07-4f9f-9649-8a5f5961965d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.663331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:37.671804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a2188-6a07-4f9f-9649-8a5f5961965d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:37.673399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a2188-6a07-4f9f-9649-8a5f5961965d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-2b2a2188-6a07-4f9f-9649-8a5f5961965d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:37.690309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:37.691504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:37.692492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:37.692492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:37.692492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:37.692492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 398/824] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:37.693006 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2188-6a07-4f9f-9649-8a5f5961965d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.745901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681191ea-1163-4b0b-a69e-1ebb777ad486 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.789259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086f484-41bb-4eb9-96a2-47453137abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.789858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086f484-41bb-4eb9-96a2-47453137abcc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.790148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086f484-41bb-4eb9-96a2-47453137abcc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.790414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086f484-41bb-4eb9-96a2-47453137abcc None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.791112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086f484-41bb-4eb9-96a2-47453137abcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:37.791415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086f484-41bb-4eb9-96a2-47453137abcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:37.792891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086f484-41bb-4eb9-96a2-47453137abcc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.815283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 427/825] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:37.815283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c33e9-5bc1-4688-9ae2-ae443cc4b2d3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.815283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c33e9-5bc1-4688-9ae2-ae443cc4b2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.815283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c33e9-5bc1-4688-9ae2-ae443cc4b2d3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.815283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 428/826] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:37.815283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c33e9-5bc1-4688-9ae2-ae443cc4b2d3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.840804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:37.846900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2188-6a07-4f9f-9649-8a5f5961965d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.903349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43294-e4cd-41e8-b5eb-8a1dc645560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.904130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43294-e4cd-41e8-b5eb-8a1dc645560c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.904405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43294-e4cd-41e8-b5eb-8a1dc645560c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.904689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43294-e4cd-41e8-b5eb-8a1dc645560c None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:37.905310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b43294-e4cd-41e8-b5eb-8a1dc645560c None admin] RBAC: Adding query filter params (type=network) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:37.906164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b43294-e4cd-41e8-b5eb-8a1dc645560c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:37.907633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b43294-e4cd-41e8-b5eb-8a1dc645560c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:37.917747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 399/827] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:37.917747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43294-e4cd-41e8-b5eb-8a1dc645560c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:37.951937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:37.958297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c33e9-5bc1-4688-9ae2-ae443cc4b2d3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:37.997769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985aa47-1edd-4c9e-9746-9269ec18c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:37.998535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985aa47-1edd-4c9e-9746-9269ec18c3fc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:37.998912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985aa47-1edd-4c9e-9746-9269ec18c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:37.999894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985aa47-1edd-4c9e-9746-9269ec18c3fc None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:38.002659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985aa47-1edd-4c9e-9746-9269ec18c3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:38.002659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985aa47-1edd-4c9e-9746-9269ec18c3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:38.002659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985aa47-1edd-4c9e-9746-9269ec18c3fc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:38.016386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 429/828] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:38.017498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe043fb1-8c94-4604-b2b3-80afbfec1168 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:38.017785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe043fb1-8c94-4604-b2b3-80afbfec1168 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:38.018057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe043fb1-8c94-4604-b2b3-80afbfec1168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:38.037075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fe043fb1-8c94-4604-b2b3-80afbfec1168 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:38.038382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fe043fb1-8c94-4604-b2b3-80afbfec1168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:38.041622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43294-e4cd-41e8-b5eb-8a1dc645560c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:38.088575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5de767-9d27-43da-b9b9-563eac14752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:38.089631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5de767-9d27-43da-b9b9-563eac14752b None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:38.090073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5de767-9d27-43da-b9b9-563eac14752b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:38.090534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5de767-9d27-43da-b9b9-563eac14752b None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/623fd6adf2af4122a5a507efb4e0cbce/roles/ea287c8c7f9442cf99fb462bb85b39b2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:38.112644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5de767-9d27-43da-b9b9-563eac14752b None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=623fd6adf2af4122a5a507efb4e0cbce, role_id=ea287c8c7f9442cf99fb462bb85b39b2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:38.114331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5de767-9d27-43da-b9b9-563eac14752b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:38.132466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 430/829] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:38.140941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe043fb1-8c94-4604-b2b3-80afbfec1168 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:38.228164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 400/830] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:59:37 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/623fd6adf2af4122a5a507efb4e0cbce/roles/ea287c8c7f9442cf99fb462bb85b39b2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:38.230740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5de767-9d27-43da-b9b9-563eac14752b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:38.277061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:38.301575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:38.335426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe043fb1-8c94-4604-b2b3-80afbfec1168 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:38.432885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b72cf3-1a71-4a7c-af13-fd0b5768a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:38.433888 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b72cf3-1a71-4a7c-af13-fd0b5768a9a2 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:38.434372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b72cf3-1a71-4a7c-af13-fd0b5768a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:38.434849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b72cf3-1a71-4a7c-af13-fd0b5768a9a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:38.439938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b72cf3-1a71-4a7c-af13-fd0b5768a9a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:38.441731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b72cf3-1a71-4a7c-af13-fd0b5768a9a2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:38.445041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5de767-9d27-43da-b9b9-563eac14752b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:38.486639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591ffa2-cc56-4240-b72b-f0766eb59f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:38.487368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591ffa2-cc56-4240-b72b-f0766eb59f44 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:38.487597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591ffa2-cc56-4240-b72b-f0766eb59f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:38.487901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591ffa2-cc56-4240-b72b-f0766eb59f44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:38.495667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591ffa2-cc56-4240-b72b-f0766eb59f44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:38.497156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591ffa2-cc56-4240-b72b-f0766eb59f44 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-1591ffa2-cc56-4240-b72b-f0766eb59f44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:38.510698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:38.511658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 401/831] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:38.513271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591ffa2-cc56-4240-b72b-f0766eb59f44 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:38.532054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 431/832] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:38.550707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b72cf3-1a71-4a7c-af13-fd0b5768a9a2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:38.646594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:38.692894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591ffa2-cc56-4240-b72b-f0766eb59f44 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:38.743164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857c435-4fef-4e6a-a599-ab72c10625f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:38.744350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857c435-4fef-4e6a-a599-ab72c10625f0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:38.744869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857c435-4fef-4e6a-a599-ab72c10625f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:38.745360 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857c435-4fef-4e6a-a599-ab72c10625f0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:38.746153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857c435-4fef-4e6a-a599-ab72c10625f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:38.747844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857c435-4fef-4e6a-a599-ab72c10625f0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a857c435-4fef-4e6a-a599-ab72c10625f0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:38.758364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:38.759370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:59:38.760294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:38.763145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 402/833] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Aug 31 10:59:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:38.768998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857c435-4fef-4e6a-a599-ab72c10625f0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:38.785231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b72cf3-1a71-4a7c-af13-fd0b5768a9a2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:38.832533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07c267-312a-4e6b-ac2b-cfc8996009f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:38.833156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07c267-312a-4e6b-ac2b-cfc8996009f2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:38.833426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07c267-312a-4e6b-ac2b-cfc8996009f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:38.833696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07c267-312a-4e6b-ac2b-cfc8996009f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:38.834394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07c267-312a-4e6b-ac2b-cfc8996009f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:38.834692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07c267-312a-4e6b-ac2b-cfc8996009f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:38.836192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07c267-312a-4e6b-ac2b-cfc8996009f2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:38.854177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 432/834] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:38.855102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07c267-312a-4e6b-ac2b-cfc8996009f2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:38.859940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:38.901459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857c435-4fef-4e6a-a599-ab72c10625f0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:38.937726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:38.945011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7cea3-5c91-4d32-a78a-1598646531d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:38.945993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7cea3-5c91-4d32-a78a-1598646531d0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:38.946444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7cea3-5c91-4d32-a78a-1598646531d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:38.946882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7cea3-5c91-4d32-a78a-1598646531d0 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:38.947699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7cea3-5c91-4d32-a78a-1598646531d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:38.948199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7cea3-5c91-4d32-a78a-1598646531d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:38.950051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7cea3-5c91-4d32-a78a-1598646531d0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:38.956450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 403/835] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 10:59:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:38.964326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7cea3-5c91-4d32-a78a-1598646531d0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:38.974412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07c267-312a-4e6b-ac2b-cfc8996009f2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:39.023848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b1bb-8c21-4317-84ea-60ad2dfffa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:39.024525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b1bb-8c21-4317-84ea-60ad2dfffa7f None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:39.024792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b1bb-8c21-4317-84ea-60ad2dfffa7f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:39.025060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b1bb-8c21-4317-84ea-60ad2dfffa7f None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/62c91e3eec414a5189befb91012955c2/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:39.027029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b1bb-8c21-4317-84ea-60ad2dfffa7f None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=62c91e3eec414a5189befb91012955c2, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:39.028528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b1bb-8c21-4317-84ea-60ad2dfffa7f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:39.103500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7cea3-5c91-4d32-a78a-1598646531d0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:39.113145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 433/836] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:59:38 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/62c91e3eec414a5189befb91012955c2/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:39.159646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4154f-44fb-4574-a49d-87dcd70875dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:39.160699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4154f-44fb-4574-a49d-87dcd70875dc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:39.161218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4154f-44fb-4574-a49d-87dcd70875dc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:39.161753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4154f-44fb-4574-a49d-87dcd70875dc None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:39.162647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4154f-44fb-4574-a49d-87dcd70875dc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:39.163167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4154f-44fb-4574-a49d-87dcd70875dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:39.164910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4154f-44fb-4574-a49d-87dcd70875dc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:39.171824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 404/837] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 10:59:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:39.431677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1aca6-39dc-4c1d-9239-87f93db11e3b None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:39.432001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1aca6-39dc-4c1d-9239-87f93db11e3b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:39.432201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1aca6-39dc-4c1d-9239-87f93db11e3b None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:39.433844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 434/838] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:39.439701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bcc79-6bd3-4885-901a-478089c10fbc None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:39.440018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bcc79-6bd3-4885-901a-478089c10fbc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:39.440292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bcc79-6bd3-4885-901a-478089c10fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:39.463798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-cf2bcc79-6bd3-4885-901a-478089c10fbc None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:39.465021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cf2bcc79-6bd3-4885-901a-478089c10fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:39.553704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:39.566524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 405/839] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:39.843225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1aca6-39dc-4c1d-9239-87f93db11e3b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:39.912187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:39.957953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1aca6-39dc-4c1d-9239-87f93db11e3b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:39.995879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c095baa-0e1c-4850-b407-85d7ff0ed380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:39.996517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c095baa-0e1c-4850-b407-85d7ff0ed380 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:39.996784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c095baa-0e1c-4850-b407-85d7ff0ed380 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:39.997051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c095baa-0e1c-4850-b407-85d7ff0ed380 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:39.997634 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c095baa-0e1c-4850-b407-85d7ff0ed380 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:39.999064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c095baa-0e1c-4850-b407-85d7ff0ed380 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5c095baa-0e1c-4850-b407-85d7ff0ed380 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:40.008980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:40.009980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:40.011028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 435/840] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:59:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:40.017169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bcc79-6bd3-4885-901a-478089c10fbc None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:40.130659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bcc79-6bd3-4885-901a-478089c10fbc None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:40.168253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717c6d5-5ea9-4bed-b85a-01e3f39d5e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:40.169273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717c6d5-5ea9-4bed-b85a-01e3f39d5e06 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:40.169754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717c6d5-5ea9-4bed-b85a-01e3f39d5e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:40.170251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717c6d5-5ea9-4bed-b85a-01e3f39d5e06 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:40.171116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717c6d5-5ea9-4bed-b85a-01e3f39d5e06 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:40.171637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717c6d5-5ea9-4bed-b85a-01e3f39d5e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:40.173344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717c6d5-5ea9-4bed-b85a-01e3f39d5e06 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:40.178674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 406/841] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:59:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:40.184444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c095baa-0e1c-4850-b407-85d7ff0ed380 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:40.303768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c095baa-0e1c-4850-b407-85d7ff0ed380 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:40.333481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:40.341816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9c1dd-5de5-4b6d-baa2-236acf5252a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:40.342729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9c1dd-5de5-4b6d-baa2-236acf5252a0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:40.343250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9c1dd-5de5-4b6d-baa2-236acf5252a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:40.343769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9c1dd-5de5-4b6d-baa2-236acf5252a0 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:40.344628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9c1dd-5de5-4b6d-baa2-236acf5252a0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:40.345212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9c1dd-5de5-4b6d-baa2-236acf5252a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:40.346845 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9c1dd-5de5-4b6d-baa2-236acf5252a0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:40.352650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 436/842] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:59:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:40.522974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312ec07-d1fe-4697-99b7-1bf31e33b3a3 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:40.523369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312ec07-d1fe-4697-99b7-1bf31e33b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:40.523839 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312ec07-d1fe-4697-99b7-1bf31e33b3a3 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:40.526245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 407/843] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:40.533043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a05d9-a33a-4000-ac1d-3dd21293cda1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:40.533494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a05d9-a33a-4000-ac1d-3dd21293cda1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:40.533937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a05d9-a33a-4000-ac1d-3dd21293cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:40.564985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-821a05d9-a33a-4000-ac1d-3dd21293cda1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:40.566734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-821a05d9-a33a-4000-ac1d-3dd21293cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:40.666150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 437/844] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:40.942616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312ec07-d1fe-4697-99b7-1bf31e33b3a3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.005326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:41.063136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312ec07-d1fe-4697-99b7-1bf31e33b3a3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:41.101538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0af1f0-94f4-4e13-b574-d18e0150c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:41.102567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0af1f0-94f4-4e13-b574-d18e0150c6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.103042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0af1f0-94f4-4e13-b574-d18e0150c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.103510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0af1f0-94f4-4e13-b574-d18e0150c6e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.115387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0af1f0-94f4-4e13-b574-d18e0150c6e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4e0af1f0-94f4-4e13-b574-d18e0150c6e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:41.120794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:41.121726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:59:41.122729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:41.125609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 408/845] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 10:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:41.131840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a05d9-a33a-4000-ac1d-3dd21293cda1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.240434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a05d9-a33a-4000-ac1d-3dd21293cda1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:41.255510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd7d75-6250-4c77-bd4c-bea8fe3e971d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.255871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd7d75-6250-4c77-bd4c-bea8fe3e971d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.256148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd7d75-6250-4c77-bd4c-bea8fe3e971d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.262115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 409/846] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:41.264075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6daf8-539b-4f55-9d52-1d177a9e4f06 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.264363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6daf8-539b-4f55-9d52-1d177a9e4f06 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.264634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6daf8-539b-4f55-9d52-1d177a9e4f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.270273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:41.282329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd90de-640b-44cb-82c5-c1d7e67de3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:41.283275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd90de-640b-44cb-82c5-c1d7e67de3ba None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.283800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd90de-640b-44cb-82c5-c1d7e67de3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.284272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd90de-640b-44cb-82c5-c1d7e67de3ba None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.285024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd90de-640b-44cb-82c5-c1d7e67de3ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:41.285326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd90de-640b-44cb-82c5-c1d7e67de3ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:41.287467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd90de-640b-44cb-82c5-c1d7e67de3ba None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:41.292438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-25c6daf8-539b-4f55-9d52-1d177a9e4f06 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:41.293645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-25c6daf8-539b-4f55-9d52-1d177a9e4f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:41.296016 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 438/847] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 10:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:41.298893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b417cdf-a8e5-47e4-97a5-f8d785c1675c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.299274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b417cdf-a8e5-47e4-97a5-f8d785c1675c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.299561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b417cdf-a8e5-47e4-97a5-f8d785c1675c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.301384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 439/848] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:41.302930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b417cdf-a8e5-47e4-97a5-f8d785c1675c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.379961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 410/849] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:41.379961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8676-03b8-46b6-bafc-367e80b0307c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.379961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8676-03b8-46b6-bafc-367e80b0307c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.379961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8676-03b8-46b6-bafc-367e80b0307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.406817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2f5b8676-03b8-46b6-bafc-367e80b0307c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:41.408094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2f5b8676-03b8-46b6-bafc-367e80b0307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:41.453568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b417cdf-a8e5-47e4-97a5-f8d785c1675c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:41.462538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:41.503854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 411/850] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:41.508396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc71b8-a36b-46c0-ab9e-ea918c2031d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:41.509041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc71b8-a36b-46c0-ab9e-ea918c2031d5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.509314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc71b8-a36b-46c0-ab9e-ea918c2031d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.509582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc71b8-a36b-46c0-ab9e-ea918c2031d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.521555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc71b8-a36b-46c0-ab9e-ea918c2031d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:41.523473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc71b8-a36b-46c0-ab9e-ea918c2031d5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c2cc71b8-a36b-46c0-ab9e-ea918c2031d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:41.545775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:41.548224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:41.549168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:41.549168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:41.549168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:41.549168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 440/851] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:41.556351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b8676-03b8-46b6-bafc-367e80b0307c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.658783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc71b8-a36b-46c0-ab9e-ea918c2031d5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.691229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b8676-03b8-46b6-bafc-367e80b0307c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:41.704996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:41.743576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef97aab-5a18-4a44-bfb2-33e1bd2db632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:41.744868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef97aab-5a18-4a44-bfb2-33e1bd2db632 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.746279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef97aab-5a18-4a44-bfb2-33e1bd2db632 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.746746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef97aab-5a18-4a44-bfb2-33e1bd2db632 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.747591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef97aab-5a18-4a44-bfb2-33e1bd2db632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:41.748112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef97aab-5a18-4a44-bfb2-33e1bd2db632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:41.750632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef97aab-5a18-4a44-bfb2-33e1bd2db632 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:41.776095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 412/852] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:41.777449 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef97aab-5a18-4a44-bfb2-33e1bd2db632 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.785851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc71b8-a36b-46c0-ab9e-ea918c2031d5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:41.819823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:41.825506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4125d2c-cef3-4d6a-af53-aade81c6e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:41.826281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4125d2c-cef3-4d6a-af53-aade81c6e040 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.826556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4125d2c-cef3-4d6a-af53-aade81c6e040 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.826824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4125d2c-cef3-4d6a-af53-aade81c6e040 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.828103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4125d2c-cef3-4d6a-af53-aade81c6e040 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:41.829455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4125d2c-cef3-4d6a-af53-aade81c6e040 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:41.878053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 441/853] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 10:59:41 2022] POST /identity/v3/services => generated 269 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:41.879382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4125d2c-cef3-4d6a-af53-aade81c6e040 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.921938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef97aab-5a18-4a44-bfb2-33e1bd2db632 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:41.997865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6798064-ac92-4a2b-bd48-60d3b7aaf353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:41.999012 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6798064-ac92-4a2b-bd48-60d3b7aaf353 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.000637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6798064-ac92-4a2b-bd48-60d3b7aaf353 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.001539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6798064-ac92-4a2b-bd48-60d3b7aaf353 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:42.019470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6798064-ac92-4a2b-bd48-60d3b7aaf353 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:42.021952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6798064-ac92-4a2b-bd48-60d3b7aaf353 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a6798064-ac92-4a2b-bd48-60d3b7aaf353 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:42.044601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:42.046928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:42.048749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:42.052045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 413/854] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 10:59:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:42.058119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6798064-ac92-4a2b-bd48-60d3b7aaf353 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:42.077610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:42.094021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4125d2c-cef3-4d6a-af53-aade81c6e040 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:42.161918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fa67f-cd21-47f7-8485-b93a589cdb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:42.163274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fa67f-cd21-47f7-8485-b93a589cdb03 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.163710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fa67f-cd21-47f7-8485-b93a589cdb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.164149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fa67f-cd21-47f7-8485-b93a589cdb03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:42.179616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fa67f-cd21-47f7-8485-b93a589cdb03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1d8fa67f-cd21-47f7-8485-b93a589cdb03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:42.185451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:42.186475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:59:42.188406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:42.191122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 442/855] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:42.193840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:42.200310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fa67f-cd21-47f7-8485-b93a589cdb03 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:42.200572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6798064-ac92-4a2b-bd48-60d3b7aaf353 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:42.256381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03280386-b409-43d2-bc18-f4338022edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:42.257286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03280386-b409-43d2-bc18-f4338022edc5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.257566 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03280386-b409-43d2-bc18-f4338022edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.257841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03280386-b409-43d2-bc18-f4338022edc5 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:42.258855 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03280386-b409-43d2-bc18-f4338022edc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:42.259572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03280386-b409-43d2-bc18-f4338022edc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:42.261063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03280386-b409-43d2-bc18-f4338022edc5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:42.291897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 414/856] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Aug 31 10:59:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:42.297331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03280386-b409-43d2-bc18-f4338022edc5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:42.334394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fa67f-cd21-47f7-8485-b93a589cdb03 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:42.377657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ca5e-477e-4934-b1cd-116e3cc56380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:42.377657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ca5e-477e-4934-b1cd-116e3cc56380 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.377657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ca5e-477e-4934-b1cd-116e3cc56380 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.377657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ca5e-477e-4934-b1cd-116e3cc56380 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:42.378093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398ca5e-477e-4934-b1cd-116e3cc56380 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:42.378334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398ca5e-477e-4934-b1cd-116e3cc56380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:42.379731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398ca5e-477e-4934-b1cd-116e3cc56380 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:42.389958 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 443/857] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:42.395533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ca5e-477e-4934-b1cd-116e3cc56380 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:42.422119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:42.422632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03280386-b409-43d2-bc18-f4338022edc5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:42.461730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beb663-646c-4d67-8f3e-69aeda82ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:42.462788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beb663-646c-4d67-8f3e-69aeda82ff68 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.463295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beb663-646c-4d67-8f3e-69aeda82ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.463849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beb663-646c-4d67-8f3e-69aeda82ff68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:42.485647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:42.525022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ca5e-477e-4934-b1cd-116e3cc56380 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:42.559925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beb663-646c-4d67-8f3e-69aeda82ff68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:42.562226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beb663-646c-4d67-8f3e-69aeda82ff68 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:42.576504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cf90b-b2b0-4a0c-a625-5337a90d5ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:42.578491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cf90b-b2b0-4a0c-a625-5337a90d5ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.579180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cf90b-b2b0-4a0c-a625-5337a90d5ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.579653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cf90b-b2b0-4a0c-a625-5337a90d5ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:42.591523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cf90b-b2b0-4a0c-a625-5337a90d5ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:42.593721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cf90b-b2b0-4a0c-a625-5337a90d5ee2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-132cf90b-b2b0-4a0c-a625-5337a90d5ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:42.610179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:42.611174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:42.612486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:42.612486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:42.612486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:42.612486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 444/858] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:42.612932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6d5e0-48e9-432e-9d74-6544a70a1f83 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.613104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6d5e0-48e9-432e-9d74-6544a70a1f83 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.613355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6d5e0-48e9-432e-9d74-6544a70a1f83 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:42.618697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 445/859] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:42.619478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6d5e0-48e9-432e-9d74-6544a70a1f83 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:42.709001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 415/860] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:42 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:59:42.710565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6337-777c-4109-9864-2c262f844a6f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.710851 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6337-777c-4109-9864-2c262f844a6f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.711126 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6337-777c-4109-9864-2c262f844a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:42.718925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:42.731784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-640d6337-777c-4109-9864-2c262f844a6f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:42.733067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-640d6337-777c-4109-9864-2c262f844a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:42.760901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6d5e0-48e9-432e-9d74-6544a70a1f83 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:42.785333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:42.803713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1eff-a392-4216-8f0e-de79c6cfff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:42.804900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1eff-a392-4216-8f0e-de79c6cfff6e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.805500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1eff-a392-4216-8f0e-de79c6cfff6e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.805779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1eff-a392-4216-8f0e-de79c6cfff6e None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:42.806475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db1eff-a392-4216-8f0e-de79c6cfff6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:42.806778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db1eff-a392-4216-8f0e-de79c6cfff6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:42.808219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db1eff-a392-4216-8f0e-de79c6cfff6e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:42.811294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 416/861] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:42 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:42.811294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d6337-777c-4109-9864-2c262f844a6f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:42.836925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 446/862] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:42.844285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1eff-a392-4216-8f0e-de79c6cfff6e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:42.947010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d6337-777c-4109-9864-2c262f844a6f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:42.978391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1eff-a392-4216-8f0e-de79c6cfff6e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:42.987003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143fcf5-e92c-4f08-9a5e-7d2e1d280df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:42.987705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143fcf5-e92c-4f08-9a5e-7d2e1d280df1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:42.988032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143fcf5-e92c-4f08-9a5e-7d2e1d280df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:42.988306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143fcf5-e92c-4f08-9a5e-7d2e1d280df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.000034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143fcf5-e92c-4f08-9a5e-7d2e1d280df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.001582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143fcf5-e92c-4f08-9a5e-7d2e1d280df1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:43.013214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-6143fcf5-e92c-4f08-9a5e-7d2e1d280df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:43.018397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:43.019542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:43.020598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:43.020598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:43.020598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:43.020598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 417/863] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:43.023284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e68ff0-e576-4eb9-9f1e-190315e3bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:43.025438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e68ff0-e576-4eb9-9f1e-190315e3bf5c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.025438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e68ff0-e576-4eb9-9f1e-190315e3bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.025438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e68ff0-e576-4eb9-9f1e-190315e3bf5c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.026423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143fcf5-e92c-4f08-9a5e-7d2e1d280df1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:43.034914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e68ff0-e576-4eb9-9f1e-190315e3bf5c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.036468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e68ff0-e576-4eb9-9f1e-190315e3bf5c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e5e68ff0-e576-4eb9-9f1e-190315e3bf5c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:43.050370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:43.051308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:43.052381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 447/864] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 10:59:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:43.061458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e68ff0-e576-4eb9-9f1e-190315e3bf5c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:43.068807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:43.169586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143fcf5-e92c-4f08-9a5e-7d2e1d280df1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:43.190973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e68ff0-e576-4eb9-9f1e-190315e3bf5c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:43.222888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb8674-a1ba-4baa-8b60-788c9d7fb1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:43.223497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb8674-a1ba-4baa-8b60-788c9d7fb1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.223796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb8674-a1ba-4baa-8b60-788c9d7fb1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.224070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb8674-a1ba-4baa-8b60-788c9d7fb1f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.224722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb8674-a1ba-4baa-8b60-788c9d7fb1f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:43.225022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb8674-a1ba-4baa-8b60-788c9d7fb1f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.226419 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb8674-a1ba-4baa-8b60-788c9d7fb1f3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:43.236393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c5c3c-9fea-40c9-84e7-4c5ec950fa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:43.237259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c5c3c-9fea-40c9-84e7-4c5ec950fa5e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.237632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c5c3c-9fea-40c9-84e7-4c5ec950fa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.237967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c5c3c-9fea-40c9-84e7-4c5ec950fa5e None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.238870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c5c3c-9fea-40c9-84e7-4c5ec950fa5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:43.239236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c5c3c-9fea-40c9-84e7-4c5ec950fa5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.240290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 418/865] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:43.240891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb8674-a1ba-4baa-8b60-788c9d7fb1f3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:43.248459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c5c3c-9fea-40c9-84e7-4c5ec950fa5e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:43.269926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 448/866] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Aug 31 10:59:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:43.271120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c5c3c-9fea-40c9-84e7-4c5ec950fa5e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:43.331137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:43.370676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:43.381408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb8674-a1ba-4baa-8b60-788c9d7fb1f3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:43.393737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c5c3c-9fea-40c9-84e7-4c5ec950fa5e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:43.422746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f73c83-6921-4f02-a0c5-ddb6b393b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:43.423519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f73c83-6921-4f02-a0c5-ddb6b393b06f None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.423872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f73c83-6921-4f02-a0c5-ddb6b393b06f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.424031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f73c83-6921-4f02-a0c5-ddb6b393b06f None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.424687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f73c83-6921-4f02-a0c5-ddb6b393b06f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.426162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f73c83-6921-4f02-a0c5-ddb6b393b06f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:43.448279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db2411-0d55-4f0f-aedf-9e4d56ef4e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:43.448916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db2411-0d55-4f0f-aedf-9e4d56ef4e03 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.449192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db2411-0d55-4f0f-aedf-9e4d56ef4e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.449459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db2411-0d55-4f0f-aedf-9e4d56ef4e03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.457648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db2411-0d55-4f0f-aedf-9e4d56ef4e03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.459076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db2411-0d55-4f0f-aedf-9e4d56ef4e03 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d9db2411-0d55-4f0f-aedf-9e4d56ef4e03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:43.471394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:43.472529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 449/867] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:43.473502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db2411-0d55-4f0f-aedf-9e4d56ef4e03 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:43.523816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 419/868] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 10:59:43 2022] POST /identity/v3/services => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:43.524342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f73c83-6921-4f02-a0c5-ddb6b393b06f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:43.621107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db2411-0d55-4f0f-aedf-9e4d56ef4e03 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:43.633783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:43.696964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f73c83-6921-4f02-a0c5-ddb6b393b06f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:43.697677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3c35-eed9-4f9e-8981-3b85395b66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:43.698533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3c35-eed9-4f9e-8981-3b85395b66df None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.699123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3c35-eed9-4f9e-8981-3b85395b66df None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.699401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3c35-eed9-4f9e-8981-3b85395b66df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.748219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27aefe-f291-400b-8f94-2cab2c22f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:43.749890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27aefe-f291-400b-8f94-2cab2c22f09f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.750317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27aefe-f291-400b-8f94-2cab2c22f09f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.750744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27aefe-f291-400b-8f94-2cab2c22f09f None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.751969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27aefe-f291-400b-8f94-2cab2c22f09f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:43.752474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27aefe-f291-400b-8f94-2cab2c22f09f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.754985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27aefe-f291-400b-8f94-2cab2c22f09f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:43.774104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 420/869] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:43.781804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27aefe-f291-400b-8f94-2cab2c22f09f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:43.791527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:43.797797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c3c35-eed9-4f9e-8981-3b85395b66df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.799341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c3c35-eed9-4f9e-8981-3b85395b66df None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:43.914402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 450/870] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:43 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:43.915423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3c35-eed9-4f9e-8981-3b85395b66df None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:43.916172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27aefe-f291-400b-8f94-2cab2c22f09f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:43.918754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:43.958871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544345b2-418f-4f8e-9875-a758b0398aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:43.959947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544345b2-418f-4f8e-9875-a758b0398aad None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.960494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544345b2-418f-4f8e-9875-a758b0398aad None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.961151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544345b2-418f-4f8e-9875-a758b0398aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.962149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544345b2-418f-4f8e-9875-a758b0398aad None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=623fd6adf2af4122a5a507efb4e0cbce) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:43.962718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544345b2-418f-4f8e-9875-a758b0398aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.964722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544345b2-418f-4f8e-9875-a758b0398aad None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:43.972443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 421/871] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:43 2022] GET /identity/v3/role_assignments?user.id=623fd6adf2af4122a5a507efb4e0cbce&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:44.039685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3c35-eed9-4f9e-8981-3b85395b66df None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.084856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5127da-879d-42fc-80f2-59a050f89587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:44.085506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5127da-879d-42fc-80f2-59a050f89587 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.085834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5127da-879d-42fc-80f2-59a050f89587 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.086110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5127da-879d-42fc-80f2-59a050f89587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.098344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5127da-879d-42fc-80f2-59a050f89587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:44.099957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5127da-879d-42fc-80f2-59a050f89587 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.106873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05743-4520-4d6a-97cb-b36ec4a2767a None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.107433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05743-4520-4d6a-97cb-b36ec4a2767a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.107433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05743-4520-4d6a-97cb-b36ec4a2767a None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.114019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 422/872] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:59:44.115993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8bde-31aa-414a-bb8e-3181f364d72e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.116349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8bde-31aa-414a-bb8e-3181f364d72e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.116691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8bde-31aa-414a-bb8e-3181f364d72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5c5127da-879d-42fc-80f2-59a050f89587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:44.118426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:44.120051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:44.121987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:44.121987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:44.121987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:44.121987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 451/873] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:44.126145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5127da-879d-42fc-80f2-59a050f89587 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.142623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2cef8bde-31aa-414a-bb8e-3181f364d72e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:44.143875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2cef8bde-31aa-414a-bb8e-3181f364d72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:44.214290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:44.242392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:44.251820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 423/874] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:59:44.290658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5127da-879d-42fc-80f2-59a050f89587 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.330049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b2687-3c3b-48bf-9a07-5a8bb6256481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:44.330677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b2687-3c3b-48bf-9a07-5a8bb6256481 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.330950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b2687-3c3b-48bf-9a07-5a8bb6256481 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.331219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b2687-3c3b-48bf-9a07-5a8bb6256481 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.331912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b2687-3c3b-48bf-9a07-5a8bb6256481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:44.332213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b2687-3c3b-48bf-9a07-5a8bb6256481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:44.333670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b2687-3c3b-48bf-9a07-5a8bb6256481 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.347868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 452/875] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:44.355793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef8bde-31aa-414a-bb8e-3181f364d72e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.485875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef8bde-31aa-414a-bb8e-3181f364d72e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.527856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07078b-1b3c-4191-ba65-668d56deaa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:44.529447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07078b-1b3c-4191-ba65-668d56deaa55 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.530221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07078b-1b3c-4191-ba65-668d56deaa55 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.530797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07078b-1b3c-4191-ba65-668d56deaa55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.532061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b2687-3c3b-48bf-9a07-5a8bb6256481 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.540209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07078b-1b3c-4191-ba65-668d56deaa55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:44.542539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07078b-1b3c-4191-ba65-668d56deaa55 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-ef07078b-1b3c-4191-ba65-668d56deaa55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:44.561512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:44.563515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:44.564452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:44.564452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:44.564452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:44.564452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:44.564452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:44.564452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:44.564452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:44.564452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:44.564452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 424/876] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:44.571126 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07078b-1b3c-4191-ba65-668d56deaa55 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.663864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:44.668926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b2687-3c3b-48bf-9a07-5a8bb6256481 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.700354 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:44.719265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07078b-1b3c-4191-ba65-668d56deaa55 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.731006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4d849-cef1-4156-8236-9b3362e4c966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:44.732382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4d849-cef1-4156-8236-9b3362e4c966 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.732893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4d849-cef1-4156-8236-9b3362e4c966 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.733913 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4d849-cef1-4156-8236-9b3362e4c966 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.735315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4d849-cef1-4156-8236-9b3362e4c966 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:44.739187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4d849-cef1-4156-8236-9b3362e4c966 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.762534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc327fef-cec1-4f0d-9273-2de95e0ce545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-84f4d849-cef1-4156-8236-9b3362e4c966 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:44.762885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:44.763884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:59:44.765363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:44.766109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc327fef-cec1-4f0d-9273-2de95e0ce545 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.766109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc327fef-cec1-4f0d-9273-2de95e0ce545 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.766109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc327fef-cec1-4f0d-9273-2de95e0ce545 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.766109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc327fef-cec1-4f0d-9273-2de95e0ce545 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:44.766348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 453/877] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Aug 31 10:59:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:44.766418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc327fef-cec1-4f0d-9273-2de95e0ce545 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:44.771799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc327fef-cec1-4f0d-9273-2de95e0ce545 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.773171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4d849-cef1-4156-8236-9b3362e4c966 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.799845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 425/878] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:44.804434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc327fef-cec1-4f0d-9273-2de95e0ce545 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.909399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4d849-cef1-4156-8236-9b3362e4c966 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.946359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7441-2782-4f0c-9558-9e7f7e8d77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:44.946969 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7441-2782-4f0c-9558-9e7f7e8d77ca None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.947097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc327fef-cec1-4f0d-9273-2de95e0ce545 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.947265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7441-2782-4f0c-9558-9e7f7e8d77ca None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.947518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7441-2782-4f0c-9558-9e7f7e8d77ca None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.948202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c7441-2782-4f0c-9558-9e7f7e8d77ca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:44.948505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c7441-2782-4f0c-9558-9e7f7e8d77ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:44.949900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c7441-2782-4f0c-9558-9e7f7e8d77ca None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.960909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 454/879] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 10:59:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:44.966590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7441-2782-4f0c-9558-9e7f7e8d77ca None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.977129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:45.005572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c62e08-704f-4d19-b11c-7ef76e443e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.005572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c62e08-704f-4d19-b11c-7ef76e443e24 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.005572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c62e08-704f-4d19-b11c-7ef76e443e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.005572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c62e08-704f-4d19-b11c-7ef76e443e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.005975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c62e08-704f-4d19-b11c-7ef76e443e24 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=62c91e3eec414a5189befb91012955c2) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:45.005975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c62e08-704f-4d19-b11c-7ef76e443e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.005975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c62e08-704f-4d19-b11c-7ef76e443e24 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.015850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 426/880] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:44 2022] GET /identity/v3/role_assignments?user.id=62c91e3eec414a5189befb91012955c2&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=55aed406476a485f99f9815f9f27cb3b => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:45.037839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:45.112418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7441-2782-4f0c-9558-9e7f7e8d77ca None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.159309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead6d8-4c65-4f64-90c7-6755de9ae6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.160350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead6d8-4c65-4f64-90c7-6755de9ae6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.160910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead6d8-4c65-4f64-90c7-6755de9ae6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.161389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead6d8-4c65-4f64-90c7-6755de9ae6d4 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.162288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead6d8-4c65-4f64-90c7-6755de9ae6d4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:45.162801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead6d8-4c65-4f64-90c7-6755de9ae6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.164492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead6d8-4c65-4f64-90c7-6755de9ae6d4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.175924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 455/881] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 10:59:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:45.177876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c62e08-704f-4d19-b11c-7ef76e443e24 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.310009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c62e08-704f-4d19-b11c-7ef76e443e24 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.349495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb22016-29c5-4c03-a6b5-17fb03fd8b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.350116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb22016-29c5-4c03-a6b5-17fb03fd8b0a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.350394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb22016-29c5-4c03-a6b5-17fb03fd8b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.350668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb22016-29c5-4c03-a6b5-17fb03fd8b0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.351373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb22016-29c5-4c03-a6b5-17fb03fd8b0a None admin] RBAC: Adding query filter params (interface=public, service_id=fd49de6778734560a36a06171157dfc3, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:45.351674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb22016-29c5-4c03-a6b5-17fb03fd8b0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.353077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb22016-29c5-4c03-a6b5-17fb03fd8b0a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.360307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 427/882] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Aug 31 10:59:45 2022] GET /identity/v3/endpoints?service_id=fd49de6778734560a36a06171157dfc3&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:45.366248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead6d8-4c65-4f64-90c7-6755de9ae6d4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.478646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead6d8-4c65-4f64-90c7-6755de9ae6d4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.489192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:45.520175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272c85-e451-4af7-a1e4-8315b613edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.520791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272c85-e451-4af7-a1e4-8315b613edba None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.521071 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272c85-e451-4af7-a1e4-8315b613edba None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.521346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272c85-e451-4af7-a1e4-8315b613edba None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.521960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31272c85-e451-4af7-a1e4-8315b613edba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.523337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31272c85-e451-4af7-a1e4-8315b613edba None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.529874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 456/883] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Aug 31 10:59:45 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:45.710560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e998a-cbee-4c52-bb19-0883f3f9c660 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.710919 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e998a-cbee-4c52-bb19-0883f3f9c660 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.711109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e998a-cbee-4c52-bb19-0883f3f9c660 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.712741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 428/884] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:45.718326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ae28e-76a4-487b-8e3e-664c0d697055 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.718731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ae28e-76a4-487b-8e3e-664c0d697055 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.719160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ae28e-76a4-487b-8e3e-664c0d697055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.747815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a08ae28e-76a4-487b-8e3e-664c0d697055 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:45.750316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a08ae28e-76a4-487b-8e3e-664c0d697055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:45.848292 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 457/885] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:46.164482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e998a-cbee-4c52-bb19-0883f3f9c660 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:46.224188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:46.285258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e998a-cbee-4c52-bb19-0883f3f9c660 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:46.320624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03aa5-af8f-4184-94a0-3ea47f1be85d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:46.320937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03aa5-af8f-4184-94a0-3ea47f1be85d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:46.321168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03aa5-af8f-4184-94a0-3ea47f1be85d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:46.322416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bb0d1-5b6a-4458-94e6-a72d260e4e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:46.322799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 458/886] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:46.323191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bb0d1-5b6a-4458-94e6-a72d260e4e9d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:46.323611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bb0d1-5b6a-4458-94e6-a72d260e4e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:46.323921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bb0d1-5b6a-4458-94e6-a72d260e4e9d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:46.324589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bb0d1-5b6a-4458-94e6-a72d260e4e9d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:46.325977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bb0d1-5b6a-4458-94e6-a72d260e4e9d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:46.328910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee09671-7859-4638-8bdc-478d40d88cb3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:46.329404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee09671-7859-4638-8bdc-478d40d88cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:46.329689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee09671-7859-4638-8bdc-478d40d88cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d36bb0d1-5b6a-4458-94e6-a72d260e4e9d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:46.336977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:46.338699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:46.341184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 429/887] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:59:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:46.347793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bb0d1-5b6a-4458-94e6-a72d260e4e9d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:46.355101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6ee09671-7859-4638-8bdc-478d40d88cb3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:46.356599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6ee09671-7859-4638-8bdc-478d40d88cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:46.451802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 459/888] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:59:46.473223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bb0d1-5b6a-4458-94e6-a72d260e4e9d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:46.487238 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:46.509039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e5879-a7cb-42f7-9e94-18fb01340798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:46.509661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e5879-a7cb-42f7-9e94-18fb01340798 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:46.509940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e5879-a7cb-42f7-9e94-18fb01340798 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:46.510207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e5879-a7cb-42f7-9e94-18fb01340798 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:46.510840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e5879-a7cb-42f7-9e94-18fb01340798 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:46.511138 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e5879-a7cb-42f7-9e94-18fb01340798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:46.512530 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e5879-a7cb-42f7-9e94-18fb01340798 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:46.518951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 430/889] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:59:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:46.524924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee09671-7859-4638-8bdc-478d40d88cb3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:46.559661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:46.638588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee09671-7859-4638-8bdc-478d40d88cb3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:46.678529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e450e-396e-4188-a74d-6d1c451525bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:46.679958 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e450e-396e-4188-a74d-6d1c451525bc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:46.680449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e450e-396e-4188-a74d-6d1c451525bc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:46.680930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e450e-396e-4188-a74d-6d1c451525bc None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:46.681899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e450e-396e-4188-a74d-6d1c451525bc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:46.682404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e450e-396e-4188-a74d-6d1c451525bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:46.684124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e450e-396e-4188-a74d-6d1c451525bc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:46.690847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 460/890] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:59:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:46.697109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e5879-a7cb-42f7-9e94-18fb01340798 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:46.753239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e450e-396e-4188-a74d-6d1c451525bc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:46.823552 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e5879-a7cb-42f7-9e94-18fb01340798 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:46.863426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:46.870696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e450e-396e-4188-a74d-6d1c451525bc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:46.880758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41a14c-c73b-492c-ab2a-f534ea3c924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:46.881765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41a14c-c73b-492c-ab2a-f534ea3c924b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:46.882977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41a14c-c73b-492c-ab2a-f534ea3c924b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:46.882977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41a14c-c73b-492c-ab2a-f534ea3c924b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:46.883832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41a14c-c73b-492c-ab2a-f534ea3c924b None admin] RBAC: Adding query filter params (interface=public, service_id=e5cda03123a9403f83c46142e4ffaf2a, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:46.884375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41a14c-c73b-492c-ab2a-f534ea3c924b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:46.886722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41a14c-c73b-492c-ab2a-f534ea3c924b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:46.899198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 431/891] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Aug 31 10:59:46 2022] GET /identity/v3/endpoints?service_id=e5cda03123a9403f83c46142e4ffaf2a&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:46.902895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41a14c-c73b-492c-ab2a-f534ea3c924b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:46.920103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e7c75-00d1-4905-93a7-ae43ac43d641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:46.920995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e7c75-00d1-4905-93a7-ae43ac43d641 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:46.921932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e7c75-00d1-4905-93a7-ae43ac43d641 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:46.922973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e7c75-00d1-4905-93a7-ae43ac43d641 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:46.939660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e7c75-00d1-4905-93a7-ae43ac43d641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0f3e7c75-00d1-4905-93a7-ae43ac43d641 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:46.946809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:46.948037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:59:46.949079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:46.957653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 461/892] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Aug 31 10:59:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:46.959372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e7c75-00d1-4905-93a7-ae43ac43d641 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:46.959852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:47.047690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41a14c-c73b-492c-ab2a-f534ea3c924b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:47.094925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f71d1-3977-458b-83c7-5e47e8c42d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:47.095584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f71d1-3977-458b-83c7-5e47e8c42d0d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:47.095985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f71d1-3977-458b-83c7-5e47e8c42d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:47.096346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f71d1-3977-458b-83c7-5e47e8c42d0d None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:47.096962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f71d1-3977-458b-83c7-5e47e8c42d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:47.098656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f71d1-3977-458b-83c7-5e47e8c42d0d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:47.115856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 432/893] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Aug 31 10:59:46 2022] GET /identity/v3/services => generated 1268 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:47.130116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e7c75-00d1-4905-93a7-ae43ac43d641 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:47.173185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a8d08-35de-429a-be7a-17225552abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:47.173843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8d08-35de-429a-be7a-17225552abcc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:47.174184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8d08-35de-429a-be7a-17225552abcc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:47.174452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a8d08-35de-429a-be7a-17225552abcc None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:47.175135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a8d08-35de-429a-be7a-17225552abcc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:47.175433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a8d08-35de-429a-be7a-17225552abcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:47.176974 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a8d08-35de-429a-be7a-17225552abcc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:47.187627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 462/894] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Aug 31 10:59:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:47.193501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f71d1-3977-458b-83c7-5e47e8c42d0d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:47.315254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f71d1-3977-458b-83c7-5e47e8c42d0d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:47.317829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:47.356938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3826acb-5a76-4f51-8681-09449abdcf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:47.357584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3826acb-5a76-4f51-8681-09449abdcf6e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:47.357866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3826acb-5a76-4f51-8681-09449abdcf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:47.358141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3826acb-5a76-4f51-8681-09449abdcf6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:47.370995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3826acb-5a76-4f51-8681-09449abdcf6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:47.372497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3826acb-5a76-4f51-8681-09449abdcf6e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a3826acb-5a76-4f51-8681-09449abdcf6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:47.388796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:47.390380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:47.391444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:47.391444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:47.391444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:47.393891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59fe6a-ce3f-4004-9b7a-0bd8ff85682f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:47.394181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59fe6a-ce3f-4004-9b7a-0bd8ff85682f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:47.394456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59fe6a-ce3f-4004-9b7a-0bd8ff85682f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:47.395956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 433/895] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:47.396421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 463/896] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:47.397231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3826acb-5a76-4f51-8681-09449abdcf6e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:47.401805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176047-806e-4594-8068-9188f825c79c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:47.402074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176047-806e-4594-8068-9188f825c79c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:47.402349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176047-806e-4594-8068-9188f825c79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:47.422409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-48176047-806e-4594-8068-9188f825c79c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:47.424201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-48176047-806e-4594-8068-9188f825c79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:47.442413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:47.518901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 464/897] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:59:47.530357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3826acb-5a76-4f51-8681-09449abdcf6e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:47.575083 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ced95-6e3f-4a6a-a8d9-fd356cbbe3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:47.576054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ced95-6e3f-4a6a-a8d9-fd356cbbe3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:47.576680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ced95-6e3f-4a6a-a8d9-fd356cbbe3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:47.577213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ced95-6e3f-4a6a-a8d9-fd356cbbe3f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:47.578312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ced95-6e3f-4a6a-a8d9-fd356cbbe3f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:47.578925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ced95-6e3f-4a6a-a8d9-fd356cbbe3f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:47.580571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ced95-6e3f-4a6a-a8d9-fd356cbbe3f7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:47.595482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 434/898] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:47.603812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176047-806e-4594-8068-9188f825c79c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:47.622306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf61f-00ca-4f60-b11f-387979c182ae None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:47.622596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf61f-00ca-4f60-b11f-387979c182ae None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:47.622870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf61f-00ca-4f60-b11f-387979c182ae None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:47.625347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 435/899] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:59:47.633612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f567f4d-352b-4db8-951c-fb0d4d172817 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:47.634079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f567f4d-352b-4db8-951c-fb0d4d172817 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:47.634534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f567f4d-352b-4db8-951c-fb0d4d172817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:47.657557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1f567f4d-352b-4db8-951c-fb0d4d172817 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:47.660226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1f567f4d-352b-4db8-951c-fb0d4d172817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:47.677974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:47.747186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 436/900] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:59:47.761147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176047-806e-4594-8068-9188f825c79c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:47.801307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152fbd-5e86-4d31-b2d9-36281f967bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:47.802019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152fbd-5e86-4d31-b2d9-36281f967bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:47.802337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152fbd-5e86-4d31-b2d9-36281f967bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:47.802690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152fbd-5e86-4d31-b2d9-36281f967bc8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:47.811515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8152fbd-5e86-4d31-b2d9-36281f967bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:47.813936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8152fbd-5e86-4d31-b2d9-36281f967bc8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d8152fbd-5e86-4d31-b2d9-36281f967bc8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:47.826827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:47.828003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:47.828971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:47.829603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f567f4d-352b-4db8-951c-fb0d4d172817 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:47.837351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 465/901] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 10:59:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:47.838671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152fbd-5e86-4d31-b2d9-36281f967bc8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:47.858107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:47.987039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152fbd-5e86-4d31-b2d9-36281f967bc8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.005362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f567f4d-352b-4db8-951c-fb0d4d172817 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.030129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e037c-2859-477e-9177-23a078ea260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.031275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e037c-2859-477e-9177-23a078ea260f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.031528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e037c-2859-477e-9177-23a078ea260f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.034341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e037c-2859-477e-9177-23a078ea260f None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.034341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e037c-2859-477e-9177-23a078ea260f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:48.034341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e037c-2859-477e-9177-23a078ea260f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.035113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e037c-2859-477e-9177-23a078ea260f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.059154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 466/902] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Aug 31 10:59:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:48.060132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e037c-2859-477e-9177-23a078ea260f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.070051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a6e5b-fb80-43aa-b718-09137ce4a982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.071075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a6e5b-fb80-43aa-b718-09137ce4a982 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.071521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a6e5b-fb80-43aa-b718-09137ce4a982 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.072025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a6e5b-fb80-43aa-b718-09137ce4a982 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.073015 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a6e5b-fb80-43aa-b718-09137ce4a982 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.075790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a6e5b-fb80-43aa-b718-09137ce4a982 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e61a6e5b-fb80-43aa-b718-09137ce4a982 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:48.092395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:48.094152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:48.095069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 437/903] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 10:59:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:48.096756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a6e5b-fb80-43aa-b718-09137ce4a982 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.115097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:48.144770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:48.191282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e037c-2859-477e-9177-23a078ea260f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.235061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f457d-17a0-40ac-9ceb-b7317923489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.236072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f457d-17a0-40ac-9ceb-b7317923489f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.236534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f457d-17a0-40ac-9ceb-b7317923489f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.237488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f457d-17a0-40ac-9ceb-b7317923489f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.238036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f457d-17a0-40ac-9ceb-b7317923489f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.240311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f457d-17a0-40ac-9ceb-b7317923489f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.252939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a6e5b-fb80-43aa-b718-09137ce4a982 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f83f457d-17a0-40ac-9ceb-b7317923489f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:48.253631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:48.254578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:48.255901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 467/904] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:48.256747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f457d-17a0-40ac-9ceb-b7317923489f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.302908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90ff4-e993-4628-808e-95d2cef2195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.303647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90ff4-e993-4628-808e-95d2cef2195d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.303952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90ff4-e993-4628-808e-95d2cef2195d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.304569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90ff4-e993-4628-808e-95d2cef2195d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.377477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f457d-17a0-40ac-9ceb-b7317923489f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.386702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90ff4-e993-4628-808e-95d2cef2195d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.388201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90ff4-e993-4628-808e-95d2cef2195d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.412197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:48.420788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:48.430213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca32fd2-8e35-4b15-ad48-e4e5afce5a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.431313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca32fd2-8e35-4b15-ad48-e4e5afce5a26 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.431763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca32fd2-8e35-4b15-ad48-e4e5afce5a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.432214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca32fd2-8e35-4b15-ad48-e4e5afce5a26 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.433266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca32fd2-8e35-4b15-ad48-e4e5afce5a26 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:48.433758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca32fd2-8e35-4b15-ad48-e4e5afce5a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.436279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca32fd2-8e35-4b15-ad48-e4e5afce5a26 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.447821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 468/905] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:48.447821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca32fd2-8e35-4b15-ad48-e4e5afce5a26 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.537270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 438/906] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:48.537911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90ff4-e993-4628-808e-95d2cef2195d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.577585 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca32fd2-8e35-4b15-ad48-e4e5afce5a26 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.629744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb697da6-5fe7-4657-adee-5ebf2c02e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.630257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb697da6-5fe7-4657-adee-5ebf2c02e2ad None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.630533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb697da6-5fe7-4657-adee-5ebf2c02e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.630802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb697da6-5fe7-4657-adee-5ebf2c02e2ad None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.631563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb697da6-5fe7-4657-adee-5ebf2c02e2ad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:48.631906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb697da6-5fe7-4657-adee-5ebf2c02e2ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.633337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb697da6-5fe7-4657-adee-5ebf2c02e2ad None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.639128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 469/907] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:48.640704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb697da6-5fe7-4657-adee-5ebf2c02e2ad None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.697416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90ff4-e993-4628-808e-95d2cef2195d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.710128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:48.711420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:48.742691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f055d-9241-4ccb-b595-ca5098c4d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.743308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f055d-9241-4ccb-b595-ca5098c4d003 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.743653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f055d-9241-4ccb-b595-ca5098c4d003 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.743881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f055d-9241-4ccb-b595-ca5098c4d003 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.744745 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f055d-9241-4ccb-b595-ca5098c4d003 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:48.745048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f055d-9241-4ccb-b595-ca5098c4d003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.746426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f055d-9241-4ccb-b595-ca5098c4d003 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.752257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 439/908] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:48.753113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f055d-9241-4ccb-b595-ca5098c4d003 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.790578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb697da6-5fe7-4657-adee-5ebf2c02e2ad None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.838936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727d9df-b4e9-46fa-93b0-2030ae3525d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.839919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727d9df-b4e9-46fa-93b0-2030ae3525d3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.840204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727d9df-b4e9-46fa-93b0-2030ae3525d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.840479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727d9df-b4e9-46fa-93b0-2030ae3525d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.855704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727d9df-b4e9-46fa-93b0-2030ae3525d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.857309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727d9df-b4e9-46fa-93b0-2030ae3525d3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0727d9df-b4e9-46fa-93b0-2030ae3525d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:48.874604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:48.875986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:48.876953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:48.876953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:48.876953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:48.880678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 470/909] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:48.881558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727d9df-b4e9-46fa-93b0-2030ae3525d3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.904797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f055d-9241-4ccb-b595-ca5098c4d003 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.959845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92074a15-65ff-4298-8304-de02048a88f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.961131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92074a15-65ff-4298-8304-de02048a88f7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.961637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92074a15-65ff-4298-8304-de02048a88f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.962293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92074a15-65ff-4298-8304-de02048a88f7 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.963634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92074a15-65ff-4298-8304-de02048a88f7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:48.964600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92074a15-65ff-4298-8304-de02048a88f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.967229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92074a15-65ff-4298-8304-de02048a88f7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.978812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 440/910] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:48.985704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92074a15-65ff-4298-8304-de02048a88f7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.031527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:49.052809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727d9df-b4e9-46fa-93b0-2030ae3525d3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.079771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:49.099978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623130-99c3-49b9-bad2-38fb49487e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.100698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623130-99c3-49b9-bad2-38fb49487e02 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.101049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623130-99c3-49b9-bad2-38fb49487e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.101329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623130-99c3-49b9-bad2-38fb49487e02 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.102007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623130-99c3-49b9-bad2-38fb49487e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:49.102383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623130-99c3-49b9-bad2-38fb49487e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.103950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623130-99c3-49b9-bad2-38fb49487e02 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.112446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92074a15-65ff-4298-8304-de02048a88f7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.118119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 471/911] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:49.126231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623130-99c3-49b9-bad2-38fb49487e02 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.184701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0234-1dde-439e-9400-cbdf3f860ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.186175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0234-1dde-439e-9400-cbdf3f860ae5 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.186606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0234-1dde-439e-9400-cbdf3f860ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.187038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0234-1dde-439e-9400-cbdf3f860ae5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.188776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0234-1dde-439e-9400-cbdf3f860ae5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.191890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0234-1dde-439e-9400-cbdf3f860ae5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.258452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623130-99c3-49b9-bad2-38fb49487e02 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.282325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 441/912] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:49.333558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd984d-f2ee-41d6-af6c-9e83a345c262 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.334070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd984d-f2ee-41d6-af6c-9e83a345c262 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.334346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd984d-f2ee-41d6-af6c-9e83a345c262 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.335164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366d4d4-5f65-4d9f-a85b-eed7f5b9116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.335843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366d4d4-5f65-4d9f-a85b-eed7f5b9116c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.336125 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366d4d4-5f65-4d9f-a85b-eed7f5b9116c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.336228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 442/913] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:59:49.336404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366d4d4-5f65-4d9f-a85b-eed7f5b9116c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.342383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfe9ac-af8f-4be8-acc9-86854f4ea17e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.343354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfe9ac-af8f-4be8-acc9-86854f4ea17e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.344324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfe9ac-af8f-4be8-acc9-86854f4ea17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.351524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366d4d4-5f65-4d9f-a85b-eed7f5b9116c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.353590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366d4d4-5f65-4d9f-a85b-eed7f5b9116c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c366d4d4-5f65-4d9f-a85b-eed7f5b9116c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:49.369069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:49.370048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:49.370939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:49.370939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:49.370939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:49.370939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:49.370939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:49.370939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:49.370939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:49.370939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:49.370939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 472/914] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:49.377688 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-83bfe9ac-af8f-4be8-acc9-86854f4ea17e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:49.378952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-83bfe9ac-af8f-4be8-acc9-86854f4ea17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:49.379596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366d4d4-5f65-4d9f-a85b-eed7f5b9116c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.419204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:49.494118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 443/915] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:49.532401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366d4d4-5f65-4d9f-a85b-eed7f5b9116c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.589856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996455d8-2e53-48e1-b148-f08ae5b8bad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.590831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996455d8-2e53-48e1-b148-f08ae5b8bad2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.591281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996455d8-2e53-48e1-b148-f08ae5b8bad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.591754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996455d8-2e53-48e1-b148-f08ae5b8bad2 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.593025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996455d8-2e53-48e1-b148-f08ae5b8bad2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:49.593551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996455d8-2e53-48e1-b148-f08ae5b8bad2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.596050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996455d8-2e53-48e1-b148-f08ae5b8bad2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.610515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 473/916] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:49.616911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfe9ac-af8f-4be8-acc9-86854f4ea17e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.645278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:49.743000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfe9ac-af8f-4be8-acc9-86854f4ea17e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.780649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735cd8-6d48-4c51-a5ed-ce027156483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.781176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735cd8-6d48-4c51-a5ed-ce027156483a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.781454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735cd8-6d48-4c51-a5ed-ce027156483a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.781728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735cd8-6d48-4c51-a5ed-ce027156483a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.782465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735cd8-6d48-4c51-a5ed-ce027156483a None admin] RBAC: Adding query filter params (role.id=b26684c206814c398b13a51afde0426d, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=623fd6adf2af4122a5a507efb4e0cbce) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:49.782771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735cd8-6d48-4c51-a5ed-ce027156483a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.784392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735cd8-6d48-4c51-a5ed-ce027156483a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.788253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996455d8-2e53-48e1-b148-f08ae5b8bad2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.790898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 444/917] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 10:59:49 2022] GET /identity/v3/role_assignments?user.id=623fd6adf2af4122a5a507efb4e0cbce&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=b26684c206814c398b13a51afde0426d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:49.900618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:49.914456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996455d8-2e53-48e1-b148-f08ae5b8bad2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.954920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5f680-5d6a-4b1f-bcab-63d98926423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.955563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5f680-5d6a-4b1f-bcab-63d98926423d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.955869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5f680-5d6a-4b1f-bcab-63d98926423d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.956144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5f680-5d6a-4b1f-bcab-63d98926423d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.956730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5f680-5d6a-4b1f-bcab-63d98926423d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.958156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5f680-5d6a-4b1f-bcab-63d98926423d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4fc5f680-5d6a-4b1f-bcab-63d98926423d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:49.967870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:49.968897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:49.969749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 474/918] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:59:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:49.975082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735cd8-6d48-4c51-a5ed-ce027156483a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:50.083817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:50.097187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735cd8-6d48-4c51-a5ed-ce027156483a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:50.134421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abd15f-de02-4be7-91c0-b47fa5c0396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:50.135041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abd15f-de02-4be7-91c0-b47fa5c0396a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:50.135318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abd15f-de02-4be7-91c0-b47fa5c0396a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:50.135588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abd15f-de02-4be7-91c0-b47fa5c0396a None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:50.136328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abd15f-de02-4be7-91c0-b47fa5c0396a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:50.136631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abd15f-de02-4be7-91c0-b47fa5c0396a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:50.138000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abd15f-de02-4be7-91c0-b47fa5c0396a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:50.144181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 445/919] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:59:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:50.149451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5f680-5d6a-4b1f-bcab-63d98926423d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:50.259535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5f680-5d6a-4b1f-bcab-63d98926423d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:50.302928 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb61fa6-2760-47ed-b732-5ddf7711aaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:50.303571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb61fa6-2760-47ed-b732-5ddf7711aaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:50.303927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb61fa6-2760-47ed-b732-5ddf7711aaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:50.304476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb61fa6-2760-47ed-b732-5ddf7711aaa9 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:50.305130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb61fa6-2760-47ed-b732-5ddf7711aaa9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:50.305434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb61fa6-2760-47ed-b732-5ddf7711aaa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:50.306836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb61fa6-2760-47ed-b732-5ddf7711aaa9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:50.313337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 475/920] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Aug 31 10:59:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:50.320842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abd15f-de02-4be7-91c0-b47fa5c0396a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:50.442079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abd15f-de02-4be7-91c0-b47fa5c0396a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:50.484308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46674d-2b7c-421f-a606-1f086fe9ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:50.484925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46674d-2b7c-421f-a606-1f086fe9ab06 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:50.485202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46674d-2b7c-421f-a606-1f086fe9ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:50.485468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46674d-2b7c-421f-a606-1f086fe9ab06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:50.486137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46674d-2b7c-421f-a606-1f086fe9ab06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:50.487497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46674d-2b7c-421f-a606-1f086fe9ab06 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:50.645043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 446/921] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:50.941406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93adc6-6ff8-4d6f-94b2-d47a429d408d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:50.941970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93adc6-6ff8-4d6f-94b2-d47a429d408d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:50.941970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93adc6-6ff8-4d6f-94b2-d47a429d408d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:50.943729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 476/922] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:59:50.949431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530398c5-3c39-48c0-bdf8-c144b439812c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:50.949715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530398c5-3c39-48c0-bdf8-c144b439812c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:50.949983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530398c5-3c39-48c0-bdf8-c144b439812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:50.978957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-530398c5-3c39-48c0-bdf8-c144b439812c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:50.980187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-530398c5-3c39-48c0-bdf8-c144b439812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:50.982745 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:51.064978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 447/923] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:51.346919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93adc6-6ff8-4d6f-94b2-d47a429d408d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:51.364717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:51.461844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93adc6-6ff8-4d6f-94b2-d47a429d408d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:51.500468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a084a-22ac-4545-8832-a51048f326dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:51.501097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a084a-22ac-4545-8832-a51048f326dd None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.501375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a084a-22ac-4545-8832-a51048f326dd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.501647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a084a-22ac-4545-8832-a51048f326dd None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.502311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a084a-22ac-4545-8832-a51048f326dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:51.503689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a084a-22ac-4545-8832-a51048f326dd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:51.535044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f61d4-2954-4916-a536-bcccda60ca8e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.535335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f61d4-2954-4916-a536-bcccda60ca8e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.535510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f61d4-2954-4916-a536-bcccda60ca8e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.536985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 448/924] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:59:51.543476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2dc08-669c-45a4-ae95-9824b003acbf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.547448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2dc08-669c-45a4-ae95-9824b003acbf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.547448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2dc08-669c-45a4-ae95-9824b003acbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.571697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4cc2dc08-669c-45a4-ae95-9824b003acbf None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:51.574008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4cc2dc08-669c-45a4-ae95-9824b003acbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:51.579894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 477/925] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 10:59:51 2022] POST /identity/v3/services => generated 241 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:51.686085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 449/926] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:59:51.966221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a084a-22ac-4545-8832-a51048f326dd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.002108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbc0b4-9508-4bfc-a327-4fbbe806be3f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.002108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbc0b4-9508-4bfc-a327-4fbbe806be3f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.002518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbc0b4-9508-4bfc-a327-4fbbe806be3f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.004137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 450/927] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:59:52.009455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05dee-a6e6-46f5-88b8-475b6d1cc667 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.009746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05dee-a6e6-46f5-88b8-475b6d1cc667 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.010028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05dee-a6e6-46f5-88b8-475b6d1cc667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.030794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-25b05dee-a6e6-46f5-88b8-475b6d1cc667 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:52.032457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-25b05dee-a6e6-46f5-88b8-475b6d1cc667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:52.055919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:52.100030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a084a-22ac-4545-8832-a51048f326dd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.102719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:52.120191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 451/928] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:52.141584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41ee76-771b-449b-a0ea-a2e7c9e834a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.142606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41ee76-771b-449b-a0ea-a2e7c9e834a1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.143103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41ee76-771b-449b-a0ea-a2e7c9e834a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.143579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41ee76-771b-449b-a0ea-a2e7c9e834a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.144455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41ee76-771b-449b-a0ea-a2e7c9e834a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.146087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41ee76-771b-449b-a0ea-a2e7c9e834a1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1f41ee76-771b-449b-a0ea-a2e7c9e834a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:52.157325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:52.158394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:59:52.159209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:52.162028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 478/929] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:52.168255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b05dee-a6e6-46f5-88b8-475b6d1cc667 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.293613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b05dee-a6e6-46f5-88b8-475b6d1cc667 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.332337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad70b33-5226-429b-938f-6fc561f02c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.332953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad70b33-5226-429b-938f-6fc561f02c64 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.333230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad70b33-5226-429b-938f-6fc561f02c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.333498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad70b33-5226-429b-938f-6fc561f02c64 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.334133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad70b33-5226-429b-938f-6fc561f02c64 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:52.334427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad70b33-5226-429b-938f-6fc561f02c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.335806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad70b33-5226-429b-938f-6fc561f02c64 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.341290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 452/930] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:52.347585 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41ee76-771b-449b-a0ea-a2e7c9e834a1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.434175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad70b33-5226-429b-938f-6fc561f02c64 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.465375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41ee76-771b-449b-a0ea-a2e7c9e834a1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.510407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:52.518535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b0ce8-94b8-41d8-9798-20e9b45e116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.519980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b0ce8-94b8-41d8-9798-20e9b45e116c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.520684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b0ce8-94b8-41d8-9798-20e9b45e116c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.521438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b0ce8-94b8-41d8-9798-20e9b45e116c None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.531210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b0ce8-94b8-41d8-9798-20e9b45e116c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:52.531210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b0ce8-94b8-41d8-9798-20e9b45e116c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.531210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b0ce8-94b8-41d8-9798-20e9b45e116c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.534935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 479/931] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:52.576185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad70b33-5226-429b-938f-6fc561f02c64 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.619582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a0736-d466-470a-9e8d-fc1353426b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.620691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a0736-d466-470a-9e8d-fc1353426b8a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.621182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a0736-d466-470a-9e8d-fc1353426b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.621677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a0736-d466-470a-9e8d-fc1353426b8a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.635466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a0736-d466-470a-9e8d-fc1353426b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-681a0736-d466-470a-9e8d-fc1353426b8a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:52.641512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:52.648218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:52.649077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 453/932] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Aug 31 10:59:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:52.653030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b0ce8-94b8-41d8-9798-20e9b45e116c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.657894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:52.762748 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3090ab-485c-42aa-938e-831a6d6c78fc None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.763273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3090ab-485c-42aa-938e-831a6d6c78fc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.763387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3090ab-485c-42aa-938e-831a6d6c78fc None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.765671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 454/933] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:59:52.771414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261a7c-e222-4498-9774-46262990c922 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.771688 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261a7c-e222-4498-9774-46262990c922 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.771988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261a7c-e222-4498-9774-46262990c922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.796827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b0ce8-94b8-41d8-9798-20e9b45e116c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.797385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d6261a7c-e222-4498-9774-46262990c922 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:52.799038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d6261a7c-e222-4498-9774-46262990c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:52.845228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de899dfb-0b78-4a64-a774-63ea0d86d7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.845908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de899dfb-0b78-4a64-a774-63ea0d86d7ea None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.846188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de899dfb-0b78-4a64-a774-63ea0d86d7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.846458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de899dfb-0b78-4a64-a774-63ea0d86d7ea None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.848154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de899dfb-0b78-4a64-a774-63ea0d86d7ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:52.848469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de899dfb-0b78-4a64-a774-63ea0d86d7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.849892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de899dfb-0b78-4a64-a774-63ea0d86d7ea None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.869847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 480/934] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Aug 31 10:59:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:52.875210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de899dfb-0b78-4a64-a774-63ea0d86d7ea None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.894617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 455/935] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:59:52.950840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:52.995960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de899dfb-0b78-4a64-a774-63ea0d86d7ea None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.038070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab280a-2b01-482a-a8e4-bb8a6452c502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.038702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab280a-2b01-482a-a8e4-bb8a6452c502 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.038968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab280a-2b01-482a-a8e4-bb8a6452c502 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.039242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab280a-2b01-482a-a8e4-bb8a6452c502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.051244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab280a-2b01-482a-a8e4-bb8a6452c502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.052915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab280a-2b01-482a-a8e4-bb8a6452c502 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-49ab280a-2b01-482a-a8e4-bb8a6452c502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:53.069020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:53.070540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:53.072085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:53.072085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:53.072085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:53.072085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 481/936] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:53.080470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261a7c-e222-4498-9774-46262990c922 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.136147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:53.177612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab280a-2b01-482a-a8e4-bb8a6452c502 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.205287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261a7c-e222-4498-9774-46262990c922 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.247086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87a656-26ab-4c14-9a63-dd935cf6a4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.247086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87a656-26ab-4c14-9a63-dd935cf6a4bb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.247086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87a656-26ab-4c14-9a63-dd935cf6a4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.247086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87a656-26ab-4c14-9a63-dd935cf6a4bb None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.247500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87a656-26ab-4c14-9a63-dd935cf6a4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:53.247500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87a656-26ab-4c14-9a63-dd935cf6a4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.248002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87a656-26ab-4c14-9a63-dd935cf6a4bb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.262099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 456/937] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:53.268966 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87a656-26ab-4c14-9a63-dd935cf6a4bb None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.296385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab280a-2b01-482a-a8e4-bb8a6452c502 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.316608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:53.336556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.337441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.338004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.338457 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.339509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.341349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.345112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING keystone.server.flask.common [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 10:59:53.404625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87a656-26ab-4c14-9a63-dd935cf6a4bb None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.407671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.sql.core [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:59:53.407671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 10:59:53.407671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [parameters: {'id': 'a0077107fa4144bbb3c991b75b9748d8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 10:59:53.407671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81883) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:59:53.413094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0077107fa4144bbb3c991b75b9748d8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0077107fa4144bbb3c991b75b9748d8. Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:59:53.425927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result.read() Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 10:59:53.426816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application yield resource Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise self.value Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application session.commit() Aug 31 10:59:53.427790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:59:53.428763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:59:53.429955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result.read() Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:59:53.432132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [parameters: {'id': 'a0077107fa4144bbb3c991b75b9748d8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:53.434385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:53.436860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:53.440940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:53.440940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 10:59:53.440940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 10:59:53.440940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:53.440940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:53.440940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 10:59:53.440940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 10:59:53.440940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a0077107fa4144bbb3c991b75b9748d8. Aug 31 10:59:53.440940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:53.442600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 482/938] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Aug 31 10:59:53 2022] POST /identity/v3/projects => generated 262 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:53.449435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.456113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaeb34-34be-4560-a42e-efea9b9efbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.457160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaeb34-34be-4560-a42e-efea9b9efbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.457647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaeb34-34be-4560-a42e-efea9b9efbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.458190 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaeb34-34be-4560-a42e-efea9b9efbe6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.467667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaeb34-34be-4560-a42e-efea9b9efbe6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.470017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaeb34-34be-4560-a42e-efea9b9efbe6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-1bbaeb34-34be-4560-a42e-efea9b9efbe6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:53.484243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:53.485517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:53.486473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:53.493961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 457/939] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:53.495223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaeb34-34be-4560-a42e-efea9b9efbe6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.584611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ebcb3-23b9-4251-88f9-b813816991e9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.626997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaeb34-34be-4560-a42e-efea9b9efbe6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.629100 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13153a2-7ece-4e83-b85f-48d84a52e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.630196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13153a2-7ece-4e83-b85f-48d84a52e884 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.630474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13153a2-7ece-4e83-b85f-48d84a52e884 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.630742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13153a2-7ece-4e83-b85f-48d84a52e884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.644981 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13153a2-7ece-4e83-b85f-48d84a52e884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.647613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13153a2-7ece-4e83-b85f-48d84a52e884 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f13153a2-7ece-4e83-b85f-48d84a52e884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:53.663202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:53.664246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:53.665175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:53.665175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:53.665175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:53.665175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:53.665175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:53.665175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:53.665175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:53.665175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:53.667883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 483/940] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:53.671432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13153a2-7ece-4e83-b85f-48d84a52e884 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.675035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6078b33-160d-468f-82eb-3f06b0911b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.675659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6078b33-160d-468f-82eb-3f06b0911b44 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.675959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6078b33-160d-468f-82eb-3f06b0911b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.676232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6078b33-160d-468f-82eb-3f06b0911b44 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.677843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6078b33-160d-468f-82eb-3f06b0911b44 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:53.678159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6078b33-160d-468f-82eb-3f06b0911b44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.679886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6078b33-160d-468f-82eb-3f06b0911b44 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.703011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 458/941] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:53.709079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6078b33-160d-468f-82eb-3f06b0911b44 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.717753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:53.746323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:53.796293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13153a2-7ece-4e83-b85f-48d84a52e884 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.837785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba7b4a-a303-4f65-b044-99fabe9c605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.838424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba7b4a-a303-4f65-b044-99fabe9c605c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.838725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba7b4a-a303-4f65-b044-99fabe9c605c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.838975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba7b4a-a303-4f65-b044-99fabe9c605c None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.839642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba7b4a-a303-4f65-b044-99fabe9c605c None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:53.839980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba7b4a-a303-4f65-b044-99fabe9c605c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.841433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba7b4a-a303-4f65-b044-99fabe9c605c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.856723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6078b33-160d-468f-82eb-3f06b0911b44 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.863723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 484/942] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:53.865341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389522-ec81-4dcf-9e31-b436b7c71dbe None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.865626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389522-ec81-4dcf-9e31-b436b7c71dbe None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.865901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389522-ec81-4dcf-9e31-b436b7c71dbe None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.867379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 485/943] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:53.873365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c80e-b403-4ed6-ac1b-34727c8498f1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.873640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c80e-b403-4ed6-ac1b-34727c8498f1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.874461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243c80e-b403-4ed6-ac1b-34727c8498f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.896992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2243c80e-b403-4ed6-ac1b-34727c8498f1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:53.898818 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2243c80e-b403-4ed6-ac1b-34727c8498f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:53.916663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c530d-37da-4ac1-ace1-ad9b5fac2efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.917852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c530d-37da-4ac1-ace1-ad9b5fac2efe None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.918277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c530d-37da-4ac1-ace1-ad9b5fac2efe None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.918960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c530d-37da-4ac1-ace1-ad9b5fac2efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.934682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c530d-37da-4ac1-ace1-ad9b5fac2efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.938044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c530d-37da-4ac1-ace1-ad9b5fac2efe None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-6b7c530d-37da-4ac1-ace1-ad9b5fac2efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:53.959538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:53.960752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:53.961774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:53.961774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:53.961774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:53.974610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 459/944] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:53.977052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c530d-37da-4ac1-ace1-ad9b5fac2efe None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:54.015260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 486/945] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:54.100476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:54.128718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c530d-37da-4ac1-ace1-ad9b5fac2efe None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:54.168752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880bcc1-c20c-4261-9846-d62c306b150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:54.169373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880bcc1-c20c-4261-9846-d62c306b150b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:54.169683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880bcc1-c20c-4261-9846-d62c306b150b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:54.169928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880bcc1-c20c-4261-9846-d62c306b150b None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:54.170587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880bcc1-c20c-4261-9846-d62c306b150b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:54.170958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880bcc1-c20c-4261-9846-d62c306b150b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:54.172833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880bcc1-c20c-4261-9846-d62c306b150b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:54.186188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 460/946] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:54.192431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243c80e-b403-4ed6-ac1b-34727c8498f1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:54.218540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:54.317299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243c80e-b403-4ed6-ac1b-34727c8498f1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:54.320250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880bcc1-c20c-4261-9846-d62c306b150b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:54.384032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ec51b-73ee-45d1-bbec-95f7b44c0032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:54.385041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec51b-73ee-45d1-bbec-95f7b44c0032 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:54.385688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec51b-73ee-45d1-bbec-95f7b44c0032 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:54.386341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec51b-73ee-45d1-bbec-95f7b44c0032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:54.404240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ec51b-73ee-45d1-bbec-95f7b44c0032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:54.406453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ec51b-73ee-45d1-bbec-95f7b44c0032 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-475ec51b-73ee-45d1-bbec-95f7b44c0032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:54.419109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:54.420058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:54.421072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:54.421072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:54.421072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:54.421072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:54.421072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:54.421072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:54.421072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:54.421072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:54.421072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 487/947] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:54.427870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ec51b-73ee-45d1-bbec-95f7b44c0032 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:54.437108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880bcc1-c20c-4261-9846-d62c306b150b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:54.485463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246d9a0-6e97-48ff-9616-018084d02b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:54.486853 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246d9a0-6e97-48ff-9616-018084d02b85 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:54.487279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246d9a0-6e97-48ff-9616-018084d02b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:54.488030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246d9a0-6e97-48ff-9616-018084d02b85 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:54.489055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246d9a0-6e97-48ff-9616-018084d02b85 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:54.490752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246d9a0-6e97-48ff-9616-018084d02b85 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:54.493976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8246d9a0-6e97-48ff-9616-018084d02b85 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:54.504647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:54.512787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:54.513633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 461/948] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 10:59:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:54.515146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246d9a0-6e97-48ff-9616-018084d02b85 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:54.553493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:54.582348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ec51b-73ee-45d1-bbec-95f7b44c0032 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:54.633827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bf4c7-0d4e-4ffe-8083-df2bcf0971fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:54.634903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bf4c7-0d4e-4ffe-8083-df2bcf0971fd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:54.635695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bf4c7-0d4e-4ffe-8083-df2bcf0971fd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:54.636373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bf4c7-0d4e-4ffe-8083-df2bcf0971fd None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:54.637224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bf4c7-0d4e-4ffe-8083-df2bcf0971fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:54.637800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bf4c7-0d4e-4ffe-8083-df2bcf0971fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:54.640787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bf4c7-0d4e-4ffe-8083-df2bcf0971fd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:54.646306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246d9a0-6e97-48ff-9616-018084d02b85 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:54.663034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 488/949] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:54.664731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089b3f2-f3ce-4511-b3d7-3b21cb77a191 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:54.665216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089b3f2-f3ce-4511-b3d7-3b21cb77a191 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:54.665489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089b3f2-f3ce-4511-b3d7-3b21cb77a191 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:54.671252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 489/950] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:54.671252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089b3f2-f3ce-4511-b3d7-3b21cb77a191 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:54.697010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e744f31-d473-4080-a799-25cd9a351f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:54.697613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e744f31-d473-4080-a799-25cd9a351f69 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:54.697896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e744f31-d473-4080-a799-25cd9a351f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:54.698163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e744f31-d473-4080-a799-25cd9a351f69 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:54.698797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e744f31-d473-4080-a799-25cd9a351f69 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:54.699263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e744f31-d473-4080-a799-25cd9a351f69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:54.700676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e744f31-d473-4080-a799-25cd9a351f69 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:54.710886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 462/951] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 10:59:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:54.710886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bc13-9222-4011-9e10-af0867723cfd None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:54.710886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bc13-9222-4011-9e10-af0867723cfd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:54.710886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bc13-9222-4011-9e10-af0867723cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:54.728248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b822bc13-9222-4011-9e10-af0867723cfd None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:54.729626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b822bc13-9222-4011-9e10-af0867723cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:54.805442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089b3f2-f3ce-4511-b3d7-3b21cb77a191 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:54.805984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:54.823845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 463/952] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:54.823845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822bc13-9222-4011-9e10-af0867723cfd None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:54.870253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bad15-2866-4634-aa4d-ddc32855d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:54.870918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bad15-2866-4634-aa4d-ddc32855d2c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:54.871190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bad15-2866-4634-aa4d-ddc32855d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:54.871455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bad15-2866-4634-aa4d-ddc32855d2c1 None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/623fd6adf2af4122a5a507efb4e0cbce/roles/b26684c206814c398b13a51afde0426d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:54.873917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bad15-2866-4634-aa4d-ddc32855d2c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=623fd6adf2af4122a5a507efb4e0cbce, role_id=b26684c206814c398b13a51afde0426d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:54.875465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bad15-2866-4634-aa4d-ddc32855d2c1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:54.957039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822bc13-9222-4011-9e10-af0867723cfd None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:54.999392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 490/953] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 10:59:54 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/623fd6adf2af4122a5a507efb4e0cbce/roles/b26684c206814c398b13a51afde0426d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:55.006917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83470b-da7c-4623-a4ed-f882062d7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:55.007993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83470b-da7c-4623-a4ed-f882062d7fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:55.008501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83470b-da7c-4623-a4ed-f882062d7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:55.008995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83470b-da7c-4623-a4ed-f882062d7fc6 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:55.009951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83470b-da7c-4623-a4ed-f882062d7fc6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:55.010444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83470b-da7c-4623-a4ed-f882062d7fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:55.012221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83470b-da7c-4623-a4ed-f882062d7fc6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:55.024574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 464/954] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 10:59:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:55.026355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bad15-2866-4634-aa4d-ddc32855d2c1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:55.030615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:55.104200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83470b-da7c-4623-a4ed-f882062d7fc6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:55.163504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bad15-2866-4634-aa4d-ddc32855d2c1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:55.187937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:55.209678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029fc89-aec0-4a9c-a2ae-aaff646835c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:55.210697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029fc89-aec0-4a9c-a2ae-aaff646835c5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:55.211651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029fc89-aec0-4a9c-a2ae-aaff646835c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:55.212199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029fc89-aec0-4a9c-a2ae-aaff646835c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:55.219938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029fc89-aec0-4a9c-a2ae-aaff646835c5 None admin] RBAC: Adding query filter params (interface=public, service_id=6847e6c6e014491986fde7e8cba1cc8a, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:55.219938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029fc89-aec0-4a9c-a2ae-aaff646835c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:55.219938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029fc89-aec0-4a9c-a2ae-aaff646835c5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:55.229337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 491/955] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Aug 31 10:59:55 2022] GET /identity/v3/endpoints?service_id=6847e6c6e014491986fde7e8cba1cc8a&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:55.237170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029fc89-aec0-4a9c-a2ae-aaff646835c5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:55.254310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83470b-da7c-4623-a4ed-f882062d7fc6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:55.306604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c680bc-8af4-467e-93ed-1d5c70a85ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:55.307716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c680bc-8af4-467e-93ed-1d5c70a85ad0 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:55.307716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c680bc-8af4-467e-93ed-1d5c70a85ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:55.308035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c680bc-8af4-467e-93ed-1d5c70a85ad0 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:55.308785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c680bc-8af4-467e-93ed-1d5c70a85ad0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:55.310232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c680bc-8af4-467e-93ed-1d5c70a85ad0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:55.331650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:55.374612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029fc89-aec0-4a9c-a2ae-aaff646835c5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:55.424062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23048346-b530-4d72-a5dd-4b95c953d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:55.425251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 465/956] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 10:59:55 2022] POST /identity/v3/services => generated 242 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:55.425509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23048346-b530-4d72-a5dd-4b95c953d259 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:55.426143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23048346-b530-4d72-a5dd-4b95c953d259 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:55.426850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23048346-b530-4d72-a5dd-4b95c953d259 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:55.428186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23048346-b530-4d72-a5dd-4b95c953d259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:55.431187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23048346-b530-4d72-a5dd-4b95c953d259 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:55.445976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 492/957] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Aug 31 10:59:55 2022] GET /identity/v3/services => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:56.044312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8bf29-fa43-4557-9a63-4d4567f3e55b None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:56.044840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8bf29-fa43-4557-9a63-4d4567f3e55b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:56.044840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8bf29-fa43-4557-9a63-4d4567f3e55b None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:56.047239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 466/958] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:56.052914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c153e-7b60-439c-bf50-e15ae70a2d1c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:56.053405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c153e-7b60-439c-bf50-e15ae70a2d1c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:56.053484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c153e-7b60-439c-bf50-e15ae70a2d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:56.073372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f20c153e-7b60-439c-bf50-e15ae70a2d1c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:56.074555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f20c153e-7b60-439c-bf50-e15ae70a2d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:56.157322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 493/959] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:56.432714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8bf29-fa43-4557-9a63-4d4567f3e55b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:56.538670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8bf29-fa43-4557-9a63-4d4567f3e55b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:56.555781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:56.578115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:56.578824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:56.579100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:56.579370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:56.580067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:56.581490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:56.584093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WARNING keystone.server.flask.common [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 10:59:56.620334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.sql.core [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:59:56.620334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 10:59:56.620334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [parameters: {'user_id': '32c14548815740fab11eb063c2337755', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 10:59:56.620334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81884) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 31 10:59:56.629450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:59:56.630350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application yield resource Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise self.value Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application session.commit() Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:59:56.631333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:59:56.632791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:59:56.633662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:59:56.635199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [parameters: {'user_id': '32c14548815740fab11eb063c2337755', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:56.637340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 10:59:56.642816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 10:59:56.645035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 10:59:56.645035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 10:59:56.645035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:59:56.645035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:59:56.645035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 10:59:56.645035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:56.645035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 467/960] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Aug 31 10:59:56 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:56.645741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c153e-7b60-439c-bf50-e15ae70a2d1c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:56.733800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:56.808402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c153e-7b60-439c-bf50-e15ae70a2d1c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:56.845581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102160b-731b-4980-831b-3bdc35befabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:56.846230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102160b-731b-4980-831b-3bdc35befabc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:56.847171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102160b-731b-4980-831b-3bdc35befabc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:56.847518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102160b-731b-4980-831b-3bdc35befabc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:56.855028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102160b-731b-4980-831b-3bdc35befabc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:56.856588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102160b-731b-4980-831b-3bdc35befabc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0102160b-731b-4980-831b-3bdc35befabc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:56.869424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:56.870591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:59:56.871851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:56.875767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 494/961] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 10:59:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:56.878901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:56.997397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3c3c9-069a-4af2-8130-2a9892b7875d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:57.035894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677464e1-a28b-43f5-8c91-a3c60eb6dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:57.036611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677464e1-a28b-43f5-8c91-a3c60eb6dd68 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:57.036967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677464e1-a28b-43f5-8c91-a3c60eb6dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:57.037314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677464e1-a28b-43f5-8c91-a3c60eb6dd68 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:57.038099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677464e1-a28b-43f5-8c91-a3c60eb6dd68 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:57.038477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677464e1-a28b-43f5-8c91-a3c60eb6dd68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:57.040219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677464e1-a28b-43f5-8c91-a3c60eb6dd68 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:57.082939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 468/962] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Aug 31 10:59:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:57.097126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbef4c9-f161-4db3-9fc7-ea018eca56df None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:57.097650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbef4c9-f161-4db3-9fc7-ea018eca56df None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:57.097650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbef4c9-f161-4db3-9fc7-ea018eca56df None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:57.099721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 495/963] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:57.109147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ff895-bc8c-410b-a822-4edb15b814cb None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:57.109147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ff895-bc8c-410b-a822-4edb15b814cb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:57.109147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ff895-bc8c-410b-a822-4edb15b814cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:57.127842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5a7ff895-bc8c-410b-a822-4edb15b814cb None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:57.129657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5a7ff895-bc8c-410b-a822-4edb15b814cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:57.166689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:57.215074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 469/964] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:57.658741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d5a8-fa70-47ff-9513-294dfce61e9c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:57.659116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d5a8-fa70-47ff-9513-294dfce61e9c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:57.659296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d5a8-fa70-47ff-9513-294dfce61e9c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:57.660728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 496/965] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:57.666203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bacd3-c1d5-4015-bb49-8d66da896cfd None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:57.666492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bacd3-c1d5-4015-bb49-8d66da896cfd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:57.666769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bacd3-c1d5-4015-bb49-8d66da896cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:57.687686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-494bacd3-c1d5-4015-bb49-8d66da896cfd None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:57.688982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-494bacd3-c1d5-4015-bb49-8d66da896cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:57.693801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105d5a8-fa70-47ff-9513-294dfce61e9c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:57.759229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 470/966] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:59:57.760620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49b3a4-4570-43d7-b228-2cee8a7694f7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:57.760898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49b3a4-4570-43d7-b228-2cee8a7694f7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:57.761165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49b3a4-4570-43d7-b228-2cee8a7694f7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:57.762393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 471/967] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 10:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:59:57.767789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c4fd6-2dc5-431b-bc1b-b067edae083f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:57.768107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c4fd6-2dc5-431b-bc1b-b067edae083f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:57.768384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c4fd6-2dc5-431b-bc1b-b067edae083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:57.786621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-740c4fd6-2dc5-431b-bc1b-b067edae083f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:57.787871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-740c4fd6-2dc5-431b-bc1b-b067edae083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:57.806756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105d5a8-fa70-47ff-9513-294dfce61e9c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:57.824906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:57.844802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fec88-7b83-4ad6-90ec-7df8b9946c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:57.845432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fec88-7b83-4ad6-90ec-7df8b9946c6d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:57.845715 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fec88-7b83-4ad6-90ec-7df8b9946c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:57.845992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fec88-7b83-4ad6-90ec-7df8b9946c6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:57.857307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fec88-7b83-4ad6-90ec-7df8b9946c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:59:57.871766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 472/968] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 10:59:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-635fec88-7b83-4ad6-90ec-7df8b9946c6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:59:57.871944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:57.873027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:57.874661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 497/969] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Aug 31 10:59:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:57.875601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c4fd6-2dc5-431b-bc1b-b067edae083f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:57.906441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:57.990406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c4fd6-2dc5-431b-bc1b-b067edae083f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.024514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8e333-c32f-4200-ac01-52cc2485751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.025121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8e333-c32f-4200-ac01-52cc2485751d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.025398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8e333-c32f-4200-ac01-52cc2485751d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.025667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8e333-c32f-4200-ac01-52cc2485751d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.026322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8e333-c32f-4200-ac01-52cc2485751d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:58.026621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8e333-c32f-4200-ac01-52cc2485751d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.027996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8e333-c32f-4200-ac01-52cc2485751d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.041038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 473/970] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Aug 31 10:59:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:58.042323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8e333-c32f-4200-ac01-52cc2485751d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.042437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fec88-7b83-4ad6-90ec-7df8b9946c6d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.154765 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fec88-7b83-4ad6-90ec-7df8b9946c6d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.159907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:58.172254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8e333-c32f-4200-ac01-52cc2485751d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.195303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05f9cf-aa2a-40c5-9a30-92c1c70c49b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.195895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05f9cf-aa2a-40c5-9a30-92c1c70c49b4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.196174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05f9cf-aa2a-40c5-9a30-92c1c70c49b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.196439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05f9cf-aa2a-40c5-9a30-92c1c70c49b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.197025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05f9cf-aa2a-40c5-9a30-92c1c70c49b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.198402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05f9cf-aa2a-40c5-9a30-92c1c70c49b4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7f05f9cf-aa2a-40c5-9a30-92c1c70c49b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:58.214584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:58.215824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:59:58.216695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:58.217598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde58c03-5675-4201-aa2d-ead50753af6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.217598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde58c03-5675-4201-aa2d-ead50753af6a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.217598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde58c03-5675-4201-aa2d-ead50753af6a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.218525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 498/971] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:58.218617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde58c03-5675-4201-aa2d-ead50753af6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.218723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05f9cf-aa2a-40c5-9a30-92c1c70c49b4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.233695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde58c03-5675-4201-aa2d-ead50753af6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.235198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde58c03-5675-4201-aa2d-ead50753af6a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-dde58c03-5675-4201-aa2d-ead50753af6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:58.252638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:58.253626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:58.254987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:58.254987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:58.254987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:58.254987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 474/972] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:59:58.254987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde58c03-5675-4201-aa2d-ead50753af6a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.271847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:58.333289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05f9cf-aa2a-40c5-9a30-92c1c70c49b4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.354806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde58c03-5675-4201-aa2d-ead50753af6a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.369142 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219d08-77d6-403d-a430-ddadf5cf83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.369769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219d08-77d6-403d-a430-ddadf5cf83e9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.370038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219d08-77d6-403d-a430-ddadf5cf83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.370306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219d08-77d6-403d-a430-ddadf5cf83e9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.370881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219d08-77d6-403d-a430-ddadf5cf83e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.372283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219d08-77d6-403d-a430-ddadf5cf83e9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-77219d08-77d6-403d-a430-ddadf5cf83e9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:58.381141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:58.382225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:58.383398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 499/973] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:58.384337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219d08-77d6-403d-a430-ddadf5cf83e9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.392401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805c8ec-819e-471c-ad46-3b9c4bc0133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.393018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c8ec-819e-471c-ad46-3b9c4bc0133e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.393299 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c8ec-819e-471c-ad46-3b9c4bc0133e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.393568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805c8ec-819e-471c-ad46-3b9c4bc0133e None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.394201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805c8ec-819e-471c-ad46-3b9c4bc0133e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:58.394502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805c8ec-819e-471c-ad46-3b9c4bc0133e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.395901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805c8ec-819e-471c-ad46-3b9c4bc0133e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.405952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 475/974] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:58.405952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805c8ec-819e-471c-ad46-3b9c4bc0133e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.406830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:58.483080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219d08-77d6-403d-a430-ddadf5cf83e9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.486442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:58.506520 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805c8ec-819e-471c-ad46-3b9c4bc0133e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.519033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48700235-c924-430c-8baf-6bbfad4c9596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.519640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700235-c924-430c-8baf-6bbfad4c9596 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.519950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700235-c924-430c-8baf-6bbfad4c9596 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.520508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700235-c924-430c-8baf-6bbfad4c9596 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.520856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48700235-c924-430c-8baf-6bbfad4c9596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:58.521153 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48700235-c924-430c-8baf-6bbfad4c9596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.522516 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48700235-c924-430c-8baf-6bbfad4c9596 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.534797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 500/975] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:58.535622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48700235-c924-430c-8baf-6bbfad4c9596 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.545206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333db1d-1fd6-427a-aaa5-3dc9dce9dc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.546631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333db1d-1fd6-427a-aaa5-3dc9dce9dc18 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.547108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333db1d-1fd6-427a-aaa5-3dc9dce9dc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.547392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333db1d-1fd6-427a-aaa5-3dc9dce9dc18 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.548378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333db1d-1fd6-427a-aaa5-3dc9dce9dc18 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:58.548787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333db1d-1fd6-427a-aaa5-3dc9dce9dc18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.550481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333db1d-1fd6-427a-aaa5-3dc9dce9dc18 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.556862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 476/976] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:58.557665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333db1d-1fd6-427a-aaa5-3dc9dce9dc18 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.625860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:58.637636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48700235-c924-430c-8baf-6bbfad4c9596 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.659439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333db1d-1fd6-427a-aaa5-3dc9dce9dc18 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.674295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821a998-c50f-4d6d-87fe-9400a98b0a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.674907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a998-c50f-4d6d-87fe-9400a98b0a56 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.675192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a998-c50f-4d6d-87fe-9400a98b0a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.675463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a998-c50f-4d6d-87fe-9400a98b0a56 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.676119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821a998-c50f-4d6d-87fe-9400a98b0a56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:58.676418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821a998-c50f-4d6d-87fe-9400a98b0a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.677789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821a998-c50f-4d6d-87fe-9400a98b0a56 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.682924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 501/977] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:58.683710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821a998-c50f-4d6d-87fe-9400a98b0a56 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.694008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cec28c-66e5-4da1-88f6-d8bb9aa087ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.694852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cec28c-66e5-4da1-88f6-d8bb9aa087ad None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.695135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cec28c-66e5-4da1-88f6-d8bb9aa087ad None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.695411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cec28c-66e5-4da1-88f6-d8bb9aa087ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.703149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cec28c-66e5-4da1-88f6-d8bb9aa087ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.704614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cec28c-66e5-4da1-88f6-d8bb9aa087ad None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.712784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-b0cec28c-66e5-4da1-88f6-d8bb9aa087ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:59:58.715728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:58.716806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:59:58.718810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 10:59:58.722340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 477/978] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:58.723326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cec28c-66e5-4da1-88f6-d8bb9aa087ad None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.785494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821a998-c50f-4d6d-87fe-9400a98b0a56 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.818604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5847c-7575-43b6-9f3c-078732495e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.819215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5847c-7575-43b6-9f3c-078732495e07 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.819493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5847c-7575-43b6-9f3c-078732495e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.819791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5847c-7575-43b6-9f3c-078732495e07 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.820421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5847c-7575-43b6-9f3c-078732495e07 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:58.820717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5847c-7575-43b6-9f3c-078732495e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.822086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5847c-7575-43b6-9f3c-078732495e07 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.825485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cec28c-66e5-4da1-88f6-d8bb9aa087ad None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.827234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 502/979] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:58.828044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5847c-7575-43b6-9f3c-078732495e07 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.858847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:58.866471 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104fbf6-3a08-414a-91c9-a75feb76464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.869758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104fbf6-3a08-414a-91c9-a75feb76464b None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.869758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104fbf6-3a08-414a-91c9-a75feb76464b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.869758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104fbf6-3a08-414a-91c9-a75feb76464b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.869758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104fbf6-3a08-414a-91c9-a75feb76464b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.869758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104fbf6-3a08-414a-91c9-a75feb76464b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.917601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:58.925883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5847c-7575-43b6-9f3c-078732495e07 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:58.958944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b60f9e-5136-4f39-a4d3-dfd869dfbb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:58.959538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60f9e-5136-4f39-a4d3-dfd869dfbb5b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:58.959836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60f9e-5136-4f39-a4d3-dfd869dfbb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:58.960108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60f9e-5136-4f39-a4d3-dfd869dfbb5b None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:58.960961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b60f9e-5136-4f39-a4d3-dfd869dfbb5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:58.961257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b60f9e-5136-4f39-a4d3-dfd869dfbb5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:58.962672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b60f9e-5136-4f39-a4d3-dfd869dfbb5b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:58.981223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 503/980] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:58.982039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b60f9e-5136-4f39-a4d3-dfd869dfbb5b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:58.989990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 478/981] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:58.991032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104fbf6-3a08-414a-91c9-a75feb76464b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:59.102380 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b60f9e-5136-4f39-a4d3-dfd869dfbb5b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:59.116430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104fbf6-3a08-414a-91c9-a75feb76464b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:59.143232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dea767-cec9-4646-832d-18c9b9d6f375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:59.144308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dea767-cec9-4646-832d-18c9b9d6f375 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:59.144308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dea767-cec9-4646-832d-18c9b9d6f375 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:59.144494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dea767-cec9-4646-832d-18c9b9d6f375 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:59.146007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dea767-cec9-4646-832d-18c9b9d6f375 None admin] RBAC: Adding query filter params (interface=public, service_id=cdec200ac6624d6e90b8f141ef3976b0, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:59.146007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dea767-cec9-4646-832d-18c9b9d6f375 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:59.146754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dea767-cec9-4646-832d-18c9b9d6f375 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:59.152192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 504/982] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/endpoints?service_id=cdec200ac6624d6e90b8f141ef3976b0&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:59.157632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dea767-cec9-4646-832d-18c9b9d6f375 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:59.160228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69657df-72b4-49c2-8b3e-b67d882f1e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:59.161318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69657df-72b4-49c2-8b3e-b67d882f1e7a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:59.161750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69657df-72b4-49c2-8b3e-b67d882f1e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:59.162173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69657df-72b4-49c2-8b3e-b67d882f1e7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:59.174446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:59.215579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:59.237684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69657df-72b4-49c2-8b3e-b67d882f1e7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:59.239148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69657df-72b4-49c2-8b3e-b67d882f1e7a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:59.270404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dea767-cec9-4646-832d-18c9b9d6f375 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:59.319010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42ec1-829a-4917-a362-6a7ab7222997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:59.319672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42ec1-829a-4917-a362-6a7ab7222997 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:59.319974 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42ec1-829a-4917-a362-6a7ab7222997 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:59.320246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42ec1-829a-4917-a362-6a7ab7222997 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:59.321133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c42ec1-829a-4917-a362-6a7ab7222997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:59.322502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c42ec1-829a-4917-a362-6a7ab7222997 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:59.330325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 505/983] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Aug 31 10:59:59 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:59.372779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 479/984] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 10:59:58 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:59.379952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42ec1-829a-4917-a362-6a7ab7222997 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:59.478461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:59.507676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42ec1-829a-4917-a362-6a7ab7222997 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:59.551884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779bb87-4f0a-4615-926c-c5850fc6c33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:59.552523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779bb87-4f0a-4615-926c-c5850fc6c33b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:59.552799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779bb87-4f0a-4615-926c-c5850fc6c33b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:59.553069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779bb87-4f0a-4615-926c-c5850fc6c33b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:59.565998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779bb87-4f0a-4615-926c-c5850fc6c33b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:59.567471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779bb87-4f0a-4615-926c-c5850fc6c33b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5779bb87-4f0a-4615-926c-c5850fc6c33b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:59:59.583985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:59.584994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:59:59.590540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:59:59.590540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:59:59.590540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:59.590540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 506/985] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 10:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:59.592549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69657df-72b4-49c2-8b3e-b67d882f1e7a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:59.682129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:59.702669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69657df-72b4-49c2-8b3e-b67d882f1e7a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:59.738656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a45bb-3b8a-411d-925c-397a3c7eabb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:59.739263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a45bb-3b8a-411d-925c-397a3c7eabb9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:59.739540 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a45bb-3b8a-411d-925c-397a3c7eabb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:59.739835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a45bb-3b8a-411d-925c-397a3c7eabb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:59.740478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a45bb-3b8a-411d-925c-397a3c7eabb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:59.740779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a45bb-3b8a-411d-925c-397a3c7eabb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:59.742201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a45bb-3b8a-411d-925c-397a3c7eabb9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:59.758973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 480/986] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 10:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:59.760312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779bb87-4f0a-4615-926c-c5850fc6c33b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:59.865402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779bb87-4f0a-4615-926c-c5850fc6c33b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:59.905917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:59.914633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8b120-93f5-47b8-8721-c2de726e47b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:59.915277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b120-93f5-47b8-8721-c2de726e47b2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:59.915548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b120-93f5-47b8-8721-c2de726e47b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:59.929021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b120-93f5-47b8-8721-c2de726e47b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:59.929021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8b120-93f5-47b8-8721-c2de726e47b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:59.929021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8b120-93f5-47b8-8721-c2de726e47b2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5fd8b120-93f5-47b8-8721-c2de726e47b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:59:59.937835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:59:59.938737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:59:59.939644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:59:59.939644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:59:59.939644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:59:59.939644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:59:59.939644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:59:59.939644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:59:59.939644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:59:59.939644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 10:59:59.945289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 507/987] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 10:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:59:59.945443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a45bb-3b8a-411d-925c-397a3c7eabb9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:00.062627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a45bb-3b8a-411d-925c-397a3c7eabb9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:00.101776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c96457-e34a-4f21-8cc6-53f5c02cf62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:00.102630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96457-e34a-4f21-8cc6-53f5c02cf62c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:00.103056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96457-e34a-4f21-8cc6-53f5c02cf62c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:00.103492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96457-e34a-4f21-8cc6-53f5c02cf62c None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:00.104361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c96457-e34a-4f21-8cc6-53f5c02cf62c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:00.104835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c96457-e34a-4f21-8cc6-53f5c02cf62c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:00.106401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c96457-e34a-4f21-8cc6-53f5c02cf62c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:00.116829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:00.125667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 481/988] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 10:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:00.126977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8b120-93f5-47b8-8721-c2de726e47b2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:00.239064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8b120-93f5-47b8-8721-c2de726e47b2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:00.274583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20d0a1-777f-4e06-82d6-fa355c0f78c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:00.275185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d0a1-777f-4e06-82d6-fa355c0f78c1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:00.275460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d0a1-777f-4e06-82d6-fa355c0f78c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:00.275728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d0a1-777f-4e06-82d6-fa355c0f78c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:00.279897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20d0a1-777f-4e06-82d6-fa355c0f78c1 None admin] RBAC: Adding query filter params (role.id=b26684c206814c398b13a51afde0426d, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=623fd6adf2af4122a5a507efb4e0cbce) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:00.279897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20d0a1-777f-4e06-82d6-fa355c0f78c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:00.279897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20d0a1-777f-4e06-82d6-fa355c0f78c1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:00.291816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 508/989] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:00:00 2022] GET /identity/v3/role_assignments?user.id=623fd6adf2af4122a5a507efb4e0cbce&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=b26684c206814c398b13a51afde0426d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:00.991608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50645004-5f6a-4fde-ae14-deb243517419 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:00.992168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50645004-5f6a-4fde-ae14-deb243517419 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:00.992168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50645004-5f6a-4fde-ae14-deb243517419 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:00.993527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 482/990] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:00.999446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ba3a2-18e8-40e6-b646-3891172d32c9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:00.999796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ba3a2-18e8-40e6-b646-3891172d32c9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:01.000037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ba3a2-18e8-40e6-b646-3891172d32c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:01.018451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-047ba3a2-18e8-40e6-b646-3891172d32c9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:01.020656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-047ba3a2-18e8-40e6-b646-3891172d32c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:01.072554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:01.090115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 509/991] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:01.297247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6bef1-347b-42f1-bc7f-6b820bf70b5f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:01.297544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6bef1-347b-42f1-bc7f-6b820bf70b5f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:01.301359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6bef1-347b-42f1-bc7f-6b820bf70b5f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:01.303879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 483/992] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:01.309118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc049db-36a9-4c72-b97b-2225512c03c2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:01.309589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc049db-36a9-4c72-b97b-2225512c03c2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:01.309670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc049db-36a9-4c72-b97b-2225512c03c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:01.328998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8fc049db-36a9-4c72-b97b-2225512c03c2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:01.330263 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8fc049db-36a9-4c72-b97b-2225512c03c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:01.358099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6bef1-347b-42f1-bc7f-6b820bf70b5f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:01.403063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 510/993] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:01.474329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6bef1-347b-42f1-bc7f-6b820bf70b5f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:01.508874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e36b6a-1eb9-4041-a81e-70561d9e6660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:01.509859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e36b6a-1eb9-4041-a81e-70561d9e6660 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:01.510356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e36b6a-1eb9-4041-a81e-70561d9e6660 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:01.510825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e36b6a-1eb9-4041-a81e-70561d9e6660 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:01.511593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e36b6a-1eb9-4041-a81e-70561d9e6660 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:01.513161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e36b6a-1eb9-4041-a81e-70561d9e6660 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-14e36b6a-1eb9-4041-a81e-70561d9e6660 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:01.522062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:01.523036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:00:01.523962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:01.527882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 484/994] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 11:00:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:00:01.531639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc049db-36a9-4c72-b97b-2225512c03c2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:01.635510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc049db-36a9-4c72-b97b-2225512c03c2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:01.650069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:01.671834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13559cf9-c5c6-4746-9a8b-1595d9fe7809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:01.672446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13559cf9-c5c6-4746-9a8b-1595d9fe7809 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:01.672713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13559cf9-c5c6-4746-9a8b-1595d9fe7809 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:01.672982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13559cf9-c5c6-4746-9a8b-1595d9fe7809 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:01.673681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13559cf9-c5c6-4746-9a8b-1595d9fe7809 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:01.673933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13559cf9-c5c6-4746-9a8b-1595d9fe7809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:01.675482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13559cf9-c5c6-4746-9a8b-1595d9fe7809 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:01.676154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e36b6a-1eb9-4041-a81e-70561d9e6660 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:01.681681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 511/995] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 11:00:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:01.687574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13559cf9-c5c6-4746-9a8b-1595d9fe7809 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:01.754812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:01.802676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e36b6a-1eb9-4041-a81e-70561d9e6660 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:01.809486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13559cf9-c5c6-4746-9a8b-1595d9fe7809 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:01.852311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b31c8-8874-48b7-908c-362de1b8b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:01.853485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b31c8-8874-48b7-908c-362de1b8b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:01.854161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b31c8-8874-48b7-908c-362de1b8b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:01.854594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b31c8-8874-48b7-908c-362de1b8b3d1 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:01.854762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a651f-bb7d-4b83-8739-05c48a7cd70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:01.855385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a651f-bb7d-4b83-8739-05c48a7cd70c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:01.855660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a651f-bb7d-4b83-8739-05c48a7cd70c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:01.855870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b31c8-8874-48b7-908c-362de1b8b3d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:01.855969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a651f-bb7d-4b83-8739-05c48a7cd70c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:01.856312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b31c8-8874-48b7-908c-362de1b8b3d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:01.856518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a651f-bb7d-4b83-8739-05c48a7cd70c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:01.857912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a651f-bb7d-4b83-8739-05c48a7cd70c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:01.859437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b31c8-8874-48b7-908c-362de1b8b3d1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-191a651f-bb7d-4b83-8739-05c48a7cd70c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:01.866945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:01.868286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:01.869554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 485/996] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:00:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:01.870944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 512/997] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 11:00:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:01.876641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a651f-bb7d-4b83-8739-05c48a7cd70c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:01.878073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b31c8-8874-48b7-908c-362de1b8b3d1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:01.944130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:02.004882 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b31c8-8874-48b7-908c-362de1b8b3d1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:02.040072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a651f-bb7d-4b83-8739-05c48a7cd70c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:02.046305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963249b0-b418-4733-a26a-9df254dd13b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:02.046913 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963249b0-b418-4733-a26a-9df254dd13b5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:02.047190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963249b0-b418-4733-a26a-9df254dd13b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:02.047463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963249b0-b418-4733-a26a-9df254dd13b5 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:02.048123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963249b0-b418-4733-a26a-9df254dd13b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:02.048431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963249b0-b418-4733-a26a-9df254dd13b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:02.049799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963249b0-b418-4733-a26a-9df254dd13b5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:02.055134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 513/998] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 11:00:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:02.060670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963249b0-b418-4733-a26a-9df254dd13b5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:02.085605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:02.094622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cd4b2-9374-4da2-9f25-d8cbfb823c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:02.104736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd4b2-9374-4da2-9f25-d8cbfb823c47 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:02.104736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd4b2-9374-4da2-9f25-d8cbfb823c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:02.104736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd4b2-9374-4da2-9f25-d8cbfb823c47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:02.104736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cd4b2-9374-4da2-9f25-d8cbfb823c47 None admin] RBAC: Adding query filter params (interface=admin, service_id=6847e6c6e014491986fde7e8cba1cc8a, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:02.104736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cd4b2-9374-4da2-9f25-d8cbfb823c47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:02.104736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cd4b2-9374-4da2-9f25-d8cbfb823c47 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:02.105792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 486/999] 10.222.0.13 () {56 vars in 1249 bytes} [Wed Aug 31 11:00:01 2022] GET /identity/v3/endpoints?service_id=6847e6c6e014491986fde7e8cba1cc8a&interface=admin®ion_id=RegionOne => generated 193 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:02.110757 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cd4b2-9374-4da2-9f25-d8cbfb823c47 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:02.198647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963249b0-b418-4733-a26a-9df254dd13b5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:02.207686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:02.236133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa86f0a-9e92-4bdf-8569-f5c7436a0be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:02.237250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86f0a-9e92-4bdf-8569-f5c7436a0be0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:02.237518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86f0a-9e92-4bdf-8569-f5c7436a0be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:02.237790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86f0a-9e92-4bdf-8569-f5c7436a0be0 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:02.238448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa86f0a-9e92-4bdf-8569-f5c7436a0be0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:02.238748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa86f0a-9e92-4bdf-8569-f5c7436a0be0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:02.240142 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa86f0a-9e92-4bdf-8569-f5c7436a0be0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:02.252963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 514/1000] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Aug 31 11:00:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:02.253551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cd4b2-9374-4da2-9f25-d8cbfb823c47 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:02.254204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa86f0a-9e92-4bdf-8569-f5c7436a0be0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:02.290247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2009097-9175-41a7-8ffc-721a9b6d109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:02.290791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009097-9175-41a7-8ffc-721a9b6d109a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:02.291141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009097-9175-41a7-8ffc-721a9b6d109a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:02.291339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009097-9175-41a7-8ffc-721a9b6d109a None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:02.292091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2009097-9175-41a7-8ffc-721a9b6d109a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:02.293398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2009097-9175-41a7-8ffc-721a9b6d109a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:02.299829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 487/1001] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Aug 31 11:00:02 2022] GET /identity/v3/services => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:02.301021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec4eaa-5506-4fe6-acc3-036eee696086 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:02.301300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec4eaa-5506-4fe6-acc3-036eee696086 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:02.301571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec4eaa-5506-4fe6-acc3-036eee696086 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:02.307437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 488/1002] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:02.308952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734820-7d39-45e2-970a-2d4900061620 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:02.309178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734820-7d39-45e2-970a-2d4900061620 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:02.309459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734820-7d39-45e2-970a-2d4900061620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:02.338909 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a0734820-7d39-45e2-970a-2d4900061620 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:02.340224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a0734820-7d39-45e2-970a-2d4900061620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:02.383798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa86f0a-9e92-4bdf-8569-f5c7436a0be0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:02.413110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:02.433532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 489/1003] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:02.444837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3f637-2f99-4430-8db7-83a5207e29e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:02.445486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3f637-2f99-4430-8db7-83a5207e29e0 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:02.445763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3f637-2f99-4430-8db7-83a5207e29e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:02.446034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3f637-2f99-4430-8db7-83a5207e29e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:02.446744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3f637-2f99-4430-8db7-83a5207e29e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:02.448216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3f637-2f99-4430-8db7-83a5207e29e0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:02.580895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 515/1004] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:00:02.713996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0734820-7d39-45e2-970a-2d4900061620 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:02.845344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0734820-7d39-45e2-970a-2d4900061620 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:02.890752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30669-35fb-4fa7-b22f-8f2b0ab977b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:02.891384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30669-35fb-4fa7-b22f-8f2b0ab977b5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:02.891651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30669-35fb-4fa7-b22f-8f2b0ab977b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:02.891966 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30669-35fb-4fa7-b22f-8f2b0ab977b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:02.892545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb30669-35fb-4fa7-b22f-8f2b0ab977b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:02.893897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb30669-35fb-4fa7-b22f-8f2b0ab977b5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-7cb30669-35fb-4fa7-b22f-8f2b0ab977b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:02.902639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:02.903633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:02.904617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 490/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Aug 31 11:00:02 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:02.910128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3f637-2f99-4430-8db7-83a5207e29e0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:02.944742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:03.022844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3f637-2f99-4430-8db7-83a5207e29e0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:03.058372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b2ce2-11db-4473-b9b4-c4f6ba18f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:03.058985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2ce2-11db-4473-b9b4-c4f6ba18f167 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:03.059265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2ce2-11db-4473-b9b4-c4f6ba18f167 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:03.059536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b2ce2-11db-4473-b9b4-c4f6ba18f167 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:03.060194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2ce2-11db-4473-b9b4-c4f6ba18f167 None admin] RBAC: Adding query filter params (name=image) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:03.060498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2ce2-11db-4473-b9b4-c4f6ba18f167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:03.062816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b2ce2-11db-4473-b9b4-c4f6ba18f167 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:03.072217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 516/1006] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:03.073701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30669-35fb-4fa7-b22f-8f2b0ab977b5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:03.122580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:03.178229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30669-35fb-4fa7-b22f-8f2b0ab977b5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:03.223067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490ad7f-1914-47ac-9ae5-20c4c46919c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:03.223684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ad7f-1914-47ac-9ae5-20c4c46919c4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:03.224183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ad7f-1914-47ac-9ae5-20c4c46919c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:03.224455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ad7f-1914-47ac-9ae5-20c4c46919c4 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:03.225097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ad7f-1914-47ac-9ae5-20c4c46919c4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:03.225393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ad7f-1914-47ac-9ae5-20c4c46919c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:03.226760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ad7f-1914-47ac-9ae5-20c4c46919c4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:03.239774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 491/1007] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:04.335816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da181a-7a63-44d4-94f5-bf9097107895 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:04.336444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da181a-7a63-44d4-94f5-bf9097107895 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:04.336444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da181a-7a63-44d4-94f5-bf9097107895 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:04.337827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 517/1008] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:04.343700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20305e-f4f0-4af5-ac8b-d834508723cc None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:04.345132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20305e-f4f0-4af5-ac8b-d834508723cc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:04.345132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20305e-f4f0-4af5-ac8b-d834508723cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:04.363513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-aa20305e-f4f0-4af5-ac8b-d834508723cc None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:04.364779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aa20305e-f4f0-4af5-ac8b-d834508723cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:04.437638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 492/1009] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:04 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:04.706185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da181a-7a63-44d4-94f5-bf9097107895 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:04.713124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e1d93-f230-44e0-88a0-0f0167de4fb9 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:04.713124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e1d93-f230-44e0-88a0-0f0167de4fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:04.713124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e1d93-f230-44e0-88a0-0f0167de4fb9 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:04.715870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 493/1010] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:00:04.726205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46f33-2247-4252-813f-e724ca1054f1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:04.726756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46f33-2247-4252-813f-e724ca1054f1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:04.726925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46f33-2247-4252-813f-e724ca1054f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:04.752174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7ef46f33-2247-4252-813f-e724ca1054f1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:04.753470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7ef46f33-2247-4252-813f-e724ca1054f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:04.798990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:04.820976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:04.832810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da181a-7a63-44d4-94f5-bf9097107895 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:04.846105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 494/1011] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:04 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:00:04.875616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230dea1-8168-4eab-8d1d-a3fb6508cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:04.876293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230dea1-8168-4eab-8d1d-a3fb6508cc2c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:04.876589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230dea1-8168-4eab-8d1d-a3fb6508cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:04.876867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230dea1-8168-4eab-8d1d-a3fb6508cc2c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:04.877439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230dea1-8168-4eab-8d1d-a3fb6508cc2c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:04.878824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230dea1-8168-4eab-8d1d-a3fb6508cc2c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a230dea1-8168-4eab-8d1d-a3fb6508cc2c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:04.888189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:04.889265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 11:00:04.890412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:04.894909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 518/1012] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Aug 31 11:00:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:04.896262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46f33-2247-4252-813f-e724ca1054f1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:05.048476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46f33-2247-4252-813f-e724ca1054f1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:05.095570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5204-51b5-4fe3-a1e9-bc3ac51d7419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:05.096230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5204-51b5-4fe3-a1e9-bc3ac51d7419 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:05.096486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5204-51b5-4fe3-a1e9-bc3ac51d7419 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:05.096844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d5204-51b5-4fe3-a1e9-bc3ac51d7419 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:05.097482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d5204-51b5-4fe3-a1e9-bc3ac51d7419 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:05.097778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d5204-51b5-4fe3-a1e9-bc3ac51d7419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:05.099256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d5204-51b5-4fe3-a1e9-bc3ac51d7419 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:05.109085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 495/1013] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 11:00:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:05.110878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230dea1-8168-4eab-8d1d-a3fb6508cc2c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:05.119204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5204-51b5-4fe3-a1e9-bc3ac51d7419 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:05.163048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:05.226394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230dea1-8168-4eab-8d1d-a3fb6508cc2c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:05.238828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d5204-51b5-4fe3-a1e9-bc3ac51d7419 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:05.269042 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c25d-184d-43e0-94f1-442a99673b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:05.269655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c25d-184d-43e0-94f1-442a99673b04 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:05.269934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c25d-184d-43e0-94f1-442a99673b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:05.270204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c25d-184d-43e0-94f1-442a99673b04 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:05.270835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c25d-184d-43e0-94f1-442a99673b04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:05.271134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c25d-184d-43e0-94f1-442a99673b04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:05.272538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260c25d-184d-43e0-94f1-442a99673b04 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:05.275525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8447b-da66-4d9e-b075-38a9d9bdffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:05.276261 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8447b-da66-4d9e-b075-38a9d9bdffc2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:05.276464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8447b-da66-4d9e-b075-38a9d9bdffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:05.276729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8447b-da66-4d9e-b075-38a9d9bdffc2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:05.277478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 519/1014] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Aug 31 11:00:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:05.278677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf062-a2c2-4a35-bffd-b9af2ae09e80 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:05.278964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf062-a2c2-4a35-bffd-b9af2ae09e80 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:05.279236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf062-a2c2-4a35-bffd-b9af2ae09e80 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:05.281080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 520/1015] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:05.283788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cf062-a2c2-4a35-bffd-b9af2ae09e80 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:05.296347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8447b-da66-4d9e-b075-38a9d9bdffc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3dc8447b-da66-4d9e-b075-38a9d9bdffc2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:00:05.301244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:05.302272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:05.303128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 496/1016] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Aug 31 11:00:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:05.303890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6cff6-b37c-4061-9f3d-489889ece9e6 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:05.304163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6cff6-b37c-4061-9f3d-489889ece9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:05.304625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6cff6-b37c-4061-9f3d-489889ece9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:05.308661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:05.323193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-12c6cff6-b37c-4061-9f3d-489889ece9e6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:05.324419 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-12c6cff6-b37c-4061-9f3d-489889ece9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:05.400953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cf062-a2c2-4a35-bffd-b9af2ae09e80 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:05.408598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 497/1017] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:05 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:05.409470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6cff6-b37c-4061-9f3d-489889ece9e6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:05.447629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b646a1-c2dc-49fa-b77f-199a112fa173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:05.448687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b646a1-c2dc-49fa-b77f-199a112fa173 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:05.448973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b646a1-c2dc-49fa-b77f-199a112fa173 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:05.449252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b646a1-c2dc-49fa-b77f-199a112fa173 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:05.449928 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b646a1-c2dc-49fa-b77f-199a112fa173 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:05.451498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b646a1-c2dc-49fa-b77f-199a112fa173 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:05.459416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:05.529675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 521/1018] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:05 2022] POST /identity/v3/endpoints => generated 325 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:00:05.573544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6cff6-b37c-4061-9f3d-489889ece9e6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:05.639612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974fd3-cc90-42d3-9e4a-3f0f1a872cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:05.640567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974fd3-cc90-42d3-9e4a-3f0f1a872cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:05.640995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974fd3-cc90-42d3-9e4a-3f0f1a872cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:05.641488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974fd3-cc90-42d3-9e4a-3f0f1a872cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:05.642392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974fd3-cc90-42d3-9e4a-3f0f1a872cc0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:05.642903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974fd3-cc90-42d3-9e4a-3f0f1a872cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:05.644552 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974fd3-cc90-42d3-9e4a-3f0f1a872cc0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:05.659418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 498/1019] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Aug 31 11:00:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:05.660989 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b646a1-c2dc-49fa-b77f-199a112fa173 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:05.710325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974fd3-cc90-42d3-9e4a-3f0f1a872cc0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:05.762783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:05.786207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b646a1-c2dc-49fa-b77f-199a112fa173 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:05.812831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:05.823848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93488e-2f95-465f-86e4-d7de2269d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:05.824784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93488e-2f95-465f-86e4-d7de2269d41b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:05.825078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93488e-2f95-465f-86e4-d7de2269d41b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:05.825446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93488e-2f95-465f-86e4-d7de2269d41b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:05.832264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974fd3-cc90-42d3-9e4a-3f0f1a872cc0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:05.838834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93488e-2f95-465f-86e4-d7de2269d41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:05.840349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93488e-2f95-465f-86e4-d7de2269d41b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ca93488e-2f95-465f-86e4-d7de2269d41b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:00:05.857400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:05.859255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:00:05.860213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:00:05.860213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:05.860213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:05.860213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 522/1020] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:05.865270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93488e-2f95-465f-86e4-d7de2269d41b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:05.873166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36b53f-20dd-4d32-9f14-2f302895b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:05.874686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b53f-20dd-4d32-9f14-2f302895b599 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:05.874907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b53f-20dd-4d32-9f14-2f302895b599 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:05.875284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b53f-20dd-4d32-9f14-2f302895b599 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:05.876024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36b53f-20dd-4d32-9f14-2f302895b599 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:05.877416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36b53f-20dd-4d32-9f14-2f302895b599 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:05.953132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 499/1021] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 11:00:05 2022] POST /identity/v3/services => generated 242 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:00:05.977031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93488e-2f95-465f-86e4-d7de2269d41b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:06.019133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:06.034202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a174a-ef7e-4334-9007-eb8453b1d028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:06.034826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a174a-ef7e-4334-9007-eb8453b1d028 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:06.035101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a174a-ef7e-4334-9007-eb8453b1d028 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:06.035374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a174a-ef7e-4334-9007-eb8453b1d028 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:06.036097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a174a-ef7e-4334-9007-eb8453b1d028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:06.036394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a174a-ef7e-4334-9007-eb8453b1d028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:06.037827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a174a-ef7e-4334-9007-eb8453b1d028 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:06.056180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 523/1022] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:06.058539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36b53f-20dd-4d32-9f14-2f302895b599 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:06.187865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36b53f-20dd-4d32-9f14-2f302895b599 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:06.239028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5199f-6296-4aab-a765-3de641a1c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:06.239705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5199f-6296-4aab-a765-3de641a1c428 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:06.240011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5199f-6296-4aab-a765-3de641a1c428 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:06.240281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5199f-6296-4aab-a765-3de641a1c428 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:06.252547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5199f-6296-4aab-a765-3de641a1c428 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:06.254070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5199f-6296-4aab-a765-3de641a1c428 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a9e5199f-6296-4aab-a765-3de641a1c428 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:00:06.266264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:06.267273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:06.268398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 500/1023] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Aug 31 11:00:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:06.274822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a174a-ef7e-4334-9007-eb8453b1d028 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:06.395619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a174a-ef7e-4334-9007-eb8453b1d028 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:06.432210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226741b-d9de-4e28-9194-62c74797ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:06.432878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226741b-d9de-4e28-9194-62c74797ca21 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:06.433103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226741b-d9de-4e28-9194-62c74797ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:06.433331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226741b-d9de-4e28-9194-62c74797ca21 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:06.434063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226741b-d9de-4e28-9194-62c74797ca21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:06.434361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226741b-d9de-4e28-9194-62c74797ca21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:06.435827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226741b-d9de-4e28-9194-62c74797ca21 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:06.455275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 524/1024] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Aug 31 11:00:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:06.460306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5199f-6296-4aab-a765-3de641a1c428 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:06.463167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:06.566937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5199f-6296-4aab-a765-3de641a1c428 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:06.602723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cbbb0-231a-48a7-8f80-c42755506d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:06.603337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cbbb0-231a-48a7-8f80-c42755506d05 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:06.603610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cbbb0-231a-48a7-8f80-c42755506d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:06.603898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cbbb0-231a-48a7-8f80-c42755506d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:06.674891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cbbb0-231a-48a7-8f80-c42755506d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:06.676363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cbbb0-231a-48a7-8f80-c42755506d05 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:06.678279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:06.794768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 501/1025] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:06 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 11:00:06.801906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226741b-d9de-4e28-9194-62c74797ca21 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:06.850120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:06.917690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226741b-d9de-4e28-9194-62c74797ca21 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:06.971536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a4b2b-f1db-4081-9658-684561e97756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:06.972566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a4b2b-f1db-4081-9658-684561e97756 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:06.973014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a4b2b-f1db-4081-9658-684561e97756 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:06.973452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a4b2b-f1db-4081-9658-684561e97756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:06.991803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a4b2b-f1db-4081-9658-684561e97756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:06.994255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a4b2b-f1db-4081-9658-684561e97756 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fd2a4b2b-f1db-4081-9658-684561e97756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:00:07.015038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:07.021278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:00:07.022430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:00:07.022430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:07.022430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:07.022430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 525/1026] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:07.024154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cbbb0-231a-48a7-8f80-c42755506d05 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:07.159538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cbbb0-231a-48a7-8f80-c42755506d05 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:07.161223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:07.197205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607c7b-5920-414e-8e26-ccf0cd545791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:07.197818 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607c7b-5920-414e-8e26-ccf0cd545791 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:07.198097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607c7b-5920-414e-8e26-ccf0cd545791 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:07.198371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57607c7b-5920-414e-8e26-ccf0cd545791 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:07.199096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607c7b-5920-414e-8e26-ccf0cd545791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:07.199406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607c7b-5920-414e-8e26-ccf0cd545791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:07.200802 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57607c7b-5920-414e-8e26-ccf0cd545791 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:07.219011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 502/1027] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:07.220917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a4b2b-f1db-4081-9658-684561e97756 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:07.357393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:07.366006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a4b2b-f1db-4081-9658-684561e97756 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:07.415891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d8dba-3fbf-42a9-bee1-3a70d5cd29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:07.416852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8dba-3fbf-42a9-bee1-3a70d5cd29af None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:07.417180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8dba-3fbf-42a9-bee1-3a70d5cd29af None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:07.417668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8dba-3fbf-42a9-bee1-3a70d5cd29af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:07.430429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d8dba-3fbf-42a9-bee1-3a70d5cd29af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:07.433184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d8dba-3fbf-42a9-bee1-3a70d5cd29af None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9d4d8dba-3fbf-42a9-bee1-3a70d5cd29af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:00:07.457595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:07.458600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:07.459534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:00:07.459534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:00:07.459534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:00:07.459534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:00:07.459534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:00:07.459534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:00:07.459534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:00:07.459534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:07.464920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 526/1028] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:07.467457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607c7b-5920-414e-8e26-ccf0cd545791 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:07.581652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57607c7b-5920-414e-8e26-ccf0cd545791 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:07.597581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e0077-331c-4197-bffe-263ec0b8a44b None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:07.597867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e0077-331c-4197-bffe-263ec0b8a44b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:07.598143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e0077-331c-4197-bffe-263ec0b8a44b None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:07.599599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 527/1029] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:07.606013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61126ea-83d1-4d6c-89e6-b4b130b58655 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:07.606317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61126ea-83d1-4d6c-89e6-b4b130b58655 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:07.606573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61126ea-83d1-4d6c-89e6-b4b130b58655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:07.627327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e61126ea-83d1-4d6c-89e6-b4b130b58655 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:07.628580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e61126ea-83d1-4d6c-89e6-b4b130b58655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:07.634439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662adf-98ad-4ce7-9819-1c69f9d79d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:07.635404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662adf-98ad-4ce7-9819-1c69f9d79d82 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:07.636005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662adf-98ad-4ce7-9819-1c69f9d79d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:07.636495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662adf-98ad-4ce7-9819-1c69f9d79d82 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:07.637416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7662adf-98ad-4ce7-9819-1c69f9d79d82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:07.637885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7662adf-98ad-4ce7-9819-1c69f9d79d82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:07.639418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7662adf-98ad-4ce7-9819-1c69f9d79d82 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:07.655458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 503/1030] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 11:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:07.663352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662adf-98ad-4ce7-9819-1c69f9d79d82 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:07.698575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:07.719798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 528/1031] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:00:07.781184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662adf-98ad-4ce7-9819-1c69f9d79d82 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:07.832876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ebea0-c765-46d0-b22f-7ced24b5162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:07.833489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebea0-c765-46d0-b22f-7ced24b5162f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:07.833763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebea0-c765-46d0-b22f-7ced24b5162f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:07.834030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebea0-c765-46d0-b22f-7ced24b5162f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:07.834754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ebea0-c765-46d0-b22f-7ced24b5162f None admin] RBAC: Adding query filter params (role.id=b26684c206814c398b13a51afde0426d, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=c9c5d8bbcf07486ea3d3e26c81135d2f) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:07.835091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ebea0-c765-46d0-b22f-7ced24b5162f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:07.836539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ebea0-c765-46d0-b22f-7ced24b5162f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:07.852019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 504/1032] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:00:07 2022] GET /identity/v3/role_assignments?user.id=c9c5d8bbcf07486ea3d3e26c81135d2f&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=b26684c206814c398b13a51afde0426d => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:07.989407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61126ea-83d1-4d6c-89e6-b4b130b58655 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:07.990273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be917f-7ccf-4cdc-ab5d-115bd86e34ff None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:07.990562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be917f-7ccf-4cdc-ab5d-115bd86e34ff None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:07.990843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be917f-7ccf-4cdc-ab5d-115bd86e34ff None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:07.992394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 505/1033] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:00:07.997702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261cac-7d06-45a3-a80c-b2923e22a56f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:07.997983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261cac-7d06-45a3-a80c-b2923e22a56f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:07.998320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261cac-7d06-45a3-a80c-b2923e22a56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.018101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7f261cac-7d06-45a3-a80c-b2923e22a56f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:08.019293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7f261cac-7d06-45a3-a80c-b2923e22a56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:08.090041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:08.102101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 506/1034] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:00:08.106610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61126ea-83d1-4d6c-89e6-b4b130b58655 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.143660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6cbb-4a48-43e4-a37b-ed5de71baba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.144326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6cbb-4a48-43e4-a37b-ed5de71baba8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.144607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6cbb-4a48-43e4-a37b-ed5de71baba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.144882 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6cbb-4a48-43e4-a37b-ed5de71baba8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.145984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac6cbb-4a48-43e4-a37b-ed5de71baba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.147436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac6cbb-4a48-43e4-a37b-ed5de71baba8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.149183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 529/1035] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:08.155074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261cac-7d06-45a3-a80c-b2923e22a56f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.174057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:08.273950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261cac-7d06-45a3-a80c-b2923e22a56f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.312366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bdb65-2295-4f93-aeec-a1d8780d72c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.312971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bdb65-2295-4f93-aeec-a1d8780d72c8 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.313243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bdb65-2295-4f93-aeec-a1d8780d72c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.313511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bdb65-2295-4f93-aeec-a1d8780d72c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.314243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bdb65-2295-4f93-aeec-a1d8780d72c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.315653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bdb65-2295-4f93-aeec-a1d8780d72c8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.385924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6cbb-4a48-43e4-a37b-ed5de71baba8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.405169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 507/1036] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 11:00:08 2022] POST /identity/v3/projects => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:08.506679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6cbb-4a48-43e4-a37b-ed5de71baba8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.544813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8c46-a479-434e-9d72-d21f6fbb149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.545497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8c46-a479-434e-9d72-d21f6fbb149e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.545911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8c46-a479-434e-9d72-d21f6fbb149e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.546183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8c46-a479-434e-9d72-d21f6fbb149e None admin] PATH_INFO: `/v3/services/image` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.546769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d8c46-a479-434e-9d72-d21f6fbb149e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.548186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d8c46-a479-434e-9d72-d21f6fbb149e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-753d8c46-a479-434e-9d72-d21f6fbb149e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:08.558575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:08.559589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:08.561987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 530/1037] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Aug 31 11:00:08 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:00:08.565717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bdb65-2295-4f93-aeec-a1d8780d72c8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.640981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:08.674901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bdb65-2295-4f93-aeec-a1d8780d72c8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.713806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9226601-5e1a-4b46-9a14-11883e1ede8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.714425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9226601-5e1a-4b46-9a14-11883e1ede8e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.714702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9226601-5e1a-4b46-9a14-11883e1ede8e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.714972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9226601-5e1a-4b46-9a14-11883e1ede8e None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.715645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9226601-5e1a-4b46-9a14-11883e1ede8e None admin] RBAC: Adding query filter params (name=image) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:08.715990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9226601-5e1a-4b46-9a14-11883e1ede8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.717408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9226601-5e1a-4b46-9a14-11883e1ede8e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.729620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 508/1038] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:08.730959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8c46-a479-434e-9d72-d21f6fbb149e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.754177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:08.868921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8c46-a479-434e-9d72-d21f6fbb149e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.915684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0161c-6d39-4089-9149-769d98200675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.916586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0161c-6d39-4089-9149-769d98200675 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.916992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0161c-6d39-4089-9149-769d98200675 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.917383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0161c-6d39-4089-9149-769d98200675 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.918151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0161c-6d39-4089-9149-769d98200675 None admin] RBAC: Adding query filter params (type=image) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:08.918574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0161c-6d39-4089-9149-769d98200675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.920877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0161c-6d39-4089-9149-769d98200675 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.934503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 531/1039] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:08.936915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9226601-5e1a-4b46-9a14-11883e1ede8e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.105721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9226601-5e1a-4b46-9a14-11883e1ede8e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.139854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:09.145946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf39531-f7f5-4b79-963c-004069e1f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.146574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf39531-f7f5-4b79-963c-004069e1f3dc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.146850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf39531-f7f5-4b79-963c-004069e1f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.147110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf39531-f7f5-4b79-963c-004069e1f3dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.152760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf39531-f7f5-4b79-963c-004069e1f3dc None admin] RBAC: Adding query filter params (interface=public, service_id=a8a9f47ff28843c3a2065159ef8c7821, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:09.152760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf39531-f7f5-4b79-963c-004069e1f3dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.152760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf39531-f7f5-4b79-963c-004069e1f3dc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.165558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 509/1040] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Aug 31 11:00:08 2022] GET /identity/v3/endpoints?service_id=a8a9f47ff28843c3a2065159ef8c7821&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:09.166922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0161c-6d39-4089-9149-769d98200675 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.272796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:09.297151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0161c-6d39-4089-9149-769d98200675 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.342269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67358b02-4871-4a11-8764-bb5fb25a12d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.343031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358b02-4871-4a11-8764-bb5fb25a12d9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.343355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358b02-4871-4a11-8764-bb5fb25a12d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.343626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67358b02-4871-4a11-8764-bb5fb25a12d9 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.344287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67358b02-4871-4a11-8764-bb5fb25a12d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.345648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67358b02-4871-4a11-8764-bb5fb25a12d9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.353257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 532/1041] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Aug 31 11:00:09 2022] GET /identity/v3/services => generated 1957 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:00:09.879718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330391eb-3790-4fa3-9ea7-41951cff4545 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.880921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330391eb-3790-4fa3-9ea7-41951cff4545 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.880921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330391eb-3790-4fa3-9ea7-41951cff4545 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.882577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 510/1042] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:09.890349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a5dcf-d0d8-447b-8699-7fe583f66d41 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.891132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a5dcf-d0d8-447b-8699-7fe583f66d41 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.891132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a5dcf-d0d8-447b-8699-7fe583f66d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.910301 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-789a5dcf-d0d8-447b-8699-7fe583f66d41 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:09.911523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-789a5dcf-d0d8-447b-8699-7fe583f66d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:09.995532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 533/1043] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:10.273485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330391eb-3790-4fa3-9ea7-41951cff4545 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.417581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330391eb-3790-4fa3-9ea7-41951cff4545 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:10.461320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13a015-0f44-4130-b9d9-f2a40fdc04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:10.461974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a015-0f44-4130-b9d9-f2a40fdc04e7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.462250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a015-0f44-4130-b9d9-f2a40fdc04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.462518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a015-0f44-4130-b9d9-f2a40fdc04e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.473915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13a015-0f44-4130-b9d9-f2a40fdc04e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3a13a015-0f44-4130-b9d9-f2a40fdc04e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:00:10.478683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:10.479634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:10.484769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 511/1044] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Aug 31 11:00:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:10.486200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a5dcf-d0d8-447b-8699-7fe583f66d41 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.595613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:10.619681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a5dcf-d0d8-447b-8699-7fe583f66d41 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:10.658343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c097cad-82dd-4c5a-a520-5b301f7574d9 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.658565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e618a7-ae1d-4650-abe8-4c212dbea4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:10.658667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c097cad-82dd-4c5a-a520-5b301f7574d9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.658758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c097cad-82dd-4c5a-a520-5b301f7574d9 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.659063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e618a7-ae1d-4650-abe8-4c212dbea4fe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.659390 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e618a7-ae1d-4650-abe8-4c212dbea4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.659669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e618a7-ae1d-4650-abe8-4c212dbea4fe None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.660338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 512/1045] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:00:10.660492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e618a7-ae1d-4650-abe8-4c212dbea4fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:10.660731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e618a7-ae1d-4650-abe8-4c212dbea4fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:10.662036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e618a7-ae1d-4650-abe8-4c212dbea4fe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:10.665465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfed922-6e6f-468d-a90a-1993529421e9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.665748 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfed922-6e6f-468d-a90a-1993529421e9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.666024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfed922-6e6f-468d-a90a-1993529421e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.675778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 534/1046] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Aug 31 11:00:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:10.676879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e618a7-ae1d-4650-abe8-4c212dbea4fe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.685333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3bfed922-6e6f-468d-a90a-1993529421e9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:10.687163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3bfed922-6e6f-468d-a90a-1993529421e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:10.752630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:10.771446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 513/1047] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:00:10.801340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e618a7-ae1d-4650-abe8-4c212dbea4fe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:10.837563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb6e92-d286-4cd3-9e68-e99f2789d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:10.838206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb6e92-d286-4cd3-9e68-e99f2789d79f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.838482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb6e92-d286-4cd3-9e68-e99f2789d79f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.838752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb6e92-d286-4cd3-9e68-e99f2789d79f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.847809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:10.852768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb6e92-d286-4cd3-9e68-e99f2789d79f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:10.854662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb6e92-d286-4cd3-9e68-e99f2789d79f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-adbb6e92-d286-4cd3-9e68-e99f2789d79f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:00:10.869476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:10.870496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:00:10.871461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:00:10.871461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:10.871461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:10.871461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 535/1048] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:10.876991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfed922-6e6f-468d-a90a-1993529421e9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.995513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfed922-6e6f-468d-a90a-1993529421e9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.034691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2dd20-8154-42fe-8119-e88c2ab7feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.035640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2dd20-8154-42fe-8119-e88c2ab7feaf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.036117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2dd20-8154-42fe-8119-e88c2ab7feaf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.036540 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2dd20-8154-42fe-8119-e88c2ab7feaf None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.037350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2dd20-8154-42fe-8119-e88c2ab7feaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:11.037801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2dd20-8154-42fe-8119-e88c2ab7feaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.039312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2dd20-8154-42fe-8119-e88c2ab7feaf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.052053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 514/1049] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:11.057870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2dd20-8154-42fe-8119-e88c2ab7feaf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.058005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb6e92-d286-4cd3-9e68-e99f2789d79f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.113640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:11.176210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2dd20-8154-42fe-8119-e88c2ab7feaf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.178513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb6e92-d286-4cd3-9e68-e99f2789d79f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.213717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7af6a-8e52-44c8-878e-8380e7442cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.214448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7af6a-8e52-44c8-878e-8380e7442cda None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.214683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7af6a-8e52-44c8-878e-8380e7442cda None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.214961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7af6a-8e52-44c8-878e-8380e7442cda None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.215788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f811436-3219-4f95-a871-8e019b967dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.216420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f811436-3219-4f95-a871-8e019b967dfa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.216808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f811436-3219-4f95-a871-8e019b967dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.217087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f811436-3219-4f95-a871-8e019b967dfa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.218210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f811436-3219-4f95-a871-8e019b967dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.219633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f811436-3219-4f95-a871-8e019b967dfa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.222946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7af6a-8e52-44c8-878e-8380e7442cda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.224410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7af6a-8e52-44c8-878e-8380e7442cda None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.226072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 536/1050] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:11.226814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f811436-3219-4f95-a871-8e019b967dfa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-46d7af6a-8e52-44c8-878e-8380e7442cda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:00:11.236310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:11.237285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 515/1051] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:11.242950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7af6a-8e52-44c8-878e-8380e7442cda None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.302135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:11.352837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f811436-3219-4f95-a871-8e019b967dfa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.353090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7af6a-8e52-44c8-878e-8380e7442cda None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.360676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:11.389446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a1900-4c73-406a-abcc-8e4e4d54cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.390351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a1900-4c73-406a-abcc-8e4e4d54cb90 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.391492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a1900-4c73-406a-abcc-8e4e4d54cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.391960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a1900-4c73-406a-abcc-8e4e4d54cb90 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.392727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a1900-4c73-406a-abcc-8e4e4d54cb90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:11.393030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a1900-4c73-406a-abcc-8e4e4d54cb90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.394464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a1900-4c73-406a-abcc-8e4e4d54cb90 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.399769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01a55-e87e-4611-a1ee-8bc367cc1e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.400377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01a55-e87e-4611-a1ee-8bc367cc1e83 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.400713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01a55-e87e-4611-a1ee-8bc367cc1e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.401026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01a55-e87e-4611-a1ee-8bc367cc1e83 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.401642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a01a55-e87e-4611-a1ee-8bc367cc1e83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.403062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a01a55-e87e-4611-a1ee-8bc367cc1e83 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.414937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 516/1052] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:11.416228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858d9e-db70-4ac0-8df6-b5291da50577 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.418148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858d9e-db70-4ac0-8df6-b5291da50577 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.418148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858d9e-db70-4ac0-8df6-b5291da50577 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.418148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 517/1053] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:11.422765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858d9e-db70-4ac0-8df6-b5291da50577 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.510891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 537/1054] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 11:00:11 2022] POST /identity/v3/users => generated 285 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:11.512219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcfed4-e3c4-4e5a-b0f8-96d6378e759f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.512506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcfed4-e3c4-4e5a-b0f8-96d6378e759f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.512782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcfed4-e3c4-4e5a-b0f8-96d6378e759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.532379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9ebcfed4-e3c4-4e5a-b0f8-96d6378e759f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:11.533633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9ebcfed4-e3c4-4e5a-b0f8-96d6378e759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:11.538812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858d9e-db70-4ac0-8df6-b5291da50577 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.584409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5aff7-a50b-4037-b3ca-6315f342d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.585092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5aff7-a50b-4037-b3ca-6315f342d546 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.585329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5aff7-a50b-4037-b3ca-6315f342d546 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.585603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5aff7-a50b-4037-b3ca-6315f342d546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.597199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5aff7-a50b-4037-b3ca-6315f342d546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.598685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5aff7-a50b-4037-b3ca-6315f342d546 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.613597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 538/1055] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-64f5aff7-a50b-4037-b3ca-6315f342d546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:00:11.615675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:11.616674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:00:11.617608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:00:11.617608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:11.617608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:11.621891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 518/1056] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:00:11.624876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcfed4-e3c4-4e5a-b0f8-96d6378e759f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.674609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:11.730694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcfed4-e3c4-4e5a-b0f8-96d6378e759f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.765610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9555aa-3646-4530-938a-4215ff481d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.766232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9555aa-3646-4530-938a-4215ff481d67 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.766507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9555aa-3646-4530-938a-4215ff481d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.766776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9555aa-3646-4530-938a-4215ff481d67 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.767423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9555aa-3646-4530-938a-4215ff481d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:11.767718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9555aa-3646-4530-938a-4215ff481d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.769113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9555aa-3646-4530-938a-4215ff481d67 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.785744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 539/1057] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:11.786962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5aff7-a50b-4037-b3ca-6315f342d546 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.807035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:11.890224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9555aa-3646-4530-938a-4215ff481d67 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.892675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5aff7-a50b-4037-b3ca-6315f342d546 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.930714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f56a-d338-4fbc-8dce-67bf79f37ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.931269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f56a-d338-4fbc-8dce-67bf79f37ffc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.931544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f56a-d338-4fbc-8dce-67bf79f37ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.931840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f56a-d338-4fbc-8dce-67bf79f37ffc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.940794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871f56a-d338-4fbc-8dce-67bf79f37ffc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.942253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871f56a-d338-4fbc-8dce-67bf79f37ffc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-c871f56a-d338-4fbc-8dce-67bf79f37ffc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:00:11.954365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:11.955284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:11.956224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:00:11.956224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:00:11.956224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:00:11.956224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:00:11.956224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:00:11.956224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:00:11.956224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:00:11.956224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:11.956224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 519/1058] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:11.962700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f56a-d338-4fbc-8dce-67bf79f37ffc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:12.005921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9555aa-3646-4530-938a-4215ff481d67 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:12.008746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:12.044550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61413442-d8ee-434f-b000-2ac782196b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:12.045626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61413442-d8ee-434f-b000-2ac782196b70 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:12.045988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61413442-d8ee-434f-b000-2ac782196b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:12.046385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61413442-d8ee-434f-b000-2ac782196b70 None admin] PATH_INFO: `/v3/services/image` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:12.046638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:12.047069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61413442-d8ee-434f-b000-2ac782196b70 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:12.048540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61413442-d8ee-434f-b000-2ac782196b70 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-61413442-d8ee-434f-b000-2ac782196b70 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:12.058991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:12.065780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:12.066624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 540/1059] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:00:12.068784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61413442-d8ee-434f-b000-2ac782196b70 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:12.075629 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f56a-d338-4fbc-8dce-67bf79f37ffc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:12.118060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ea301-7268-4716-80a3-82d8f700ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:12.118951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ea301-7268-4716-80a3-82d8f700ac8c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:12.119363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ea301-7268-4716-80a3-82d8f700ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:12.119824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ea301-7268-4716-80a3-82d8f700ac8c None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:12.120727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ea301-7268-4716-80a3-82d8f700ac8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:12.121045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ea301-7268-4716-80a3-82d8f700ac8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:12.123869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ea301-7268-4716-80a3-82d8f700ac8c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:12.136879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 520/1060] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:12.143915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ea301-7268-4716-80a3-82d8f700ac8c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:12.200754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61413442-d8ee-434f-b000-2ac782196b70 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:12.251785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b32b32-84f1-4ec3-a444-d77424348789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:12.252734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b32b32-84f1-4ec3-a444-d77424348789 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:12.253012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b32b32-84f1-4ec3-a444-d77424348789 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:12.253396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b32b32-84f1-4ec3-a444-d77424348789 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:12.254107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b32b32-84f1-4ec3-a444-d77424348789 None admin] RBAC: Adding query filter params (name=image) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:12.254416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b32b32-84f1-4ec3-a444-d77424348789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:12.256421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b32b32-84f1-4ec3-a444-d77424348789 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:12.263453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 541/1061] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:12.269616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b32b32-84f1-4ec3-a444-d77424348789 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:12.290618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ea301-7268-4716-80a3-82d8f700ac8c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:12.303026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:12.344638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268000ff-0d34-49ee-a4d5-4e5d289ecbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:12.345349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268000ff-0d34-49ee-a4d5-4e5d289ecbf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:12.345663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268000ff-0d34-49ee-a4d5-4e5d289ecbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:12.345873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268000ff-0d34-49ee-a4d5-4e5d289ecbf0 None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/c9c5d8bbcf07486ea3d3e26c81135d2f/roles/b26684c206814c398b13a51afde0426d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:12.348219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268000ff-0d34-49ee-a4d5-4e5d289ecbf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=c9c5d8bbcf07486ea3d3e26c81135d2f, role_id=b26684c206814c398b13a51afde0426d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:12.349880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268000ff-0d34-49ee-a4d5-4e5d289ecbf0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:12.354180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:12.383409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b32b32-84f1-4ec3-a444-d77424348789 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:12.417812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca3fb7-7ae3-497a-91cd-95988dc34105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:12.418505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca3fb7-7ae3-497a-91cd-95988dc34105 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:12.418888 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca3fb7-7ae3-497a-91cd-95988dc34105 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:12.419184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca3fb7-7ae3-497a-91cd-95988dc34105 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:12.420539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca3fb7-7ae3-497a-91cd-95988dc34105 None admin] RBAC: Adding query filter params (type=image) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:12.420939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca3fb7-7ae3-497a-91cd-95988dc34105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:12.422683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca3fb7-7ae3-497a-91cd-95988dc34105 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:12.427883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 542/1062] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:12.433886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca3fb7-7ae3-497a-91cd-95988dc34105 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:12.443595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 521/1063] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 11:00:12 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/c9c5d8bbcf07486ea3d3e26c81135d2f/roles/b26684c206814c398b13a51afde0426d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:00:12.571778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:12.578860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca3fb7-7ae3-497a-91cd-95988dc34105 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:12.620414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea24f0-d6b5-4217-b8c9-a2a5207369e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:12.621029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea24f0-d6b5-4217-b8c9-a2a5207369e3 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:12.621303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea24f0-d6b5-4217-b8c9-a2a5207369e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:12.621570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea24f0-d6b5-4217-b8c9-a2a5207369e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:12.622242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea24f0-d6b5-4217-b8c9-a2a5207369e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:12.624161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea24f0-d6b5-4217-b8c9-a2a5207369e3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:12.766822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 543/1064] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:13.578933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8d32e-9847-45f3-bc78-05c851d88fb7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:13.579644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8d32e-9847-45f3-bc78-05c851d88fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:13.579644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8d32e-9847-45f3-bc78-05c851d88fb7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:13.580964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 522/1065] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:13.586410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef59a65-ab88-44e0-8c78-8dc1bf29a732 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:13.586841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef59a65-ab88-44e0-8c78-8dc1bf29a732 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:13.586940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef59a65-ab88-44e0-8c78-8dc1bf29a732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:13.605916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fef59a65-ab88-44e0-8c78-8dc1bf29a732 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:13.607098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fef59a65-ab88-44e0-8c78-8dc1bf29a732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:13.687225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 544/1066] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:13.959279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8d32e-9847-45f3-bc78-05c851d88fb7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:14.072031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8d32e-9847-45f3-bc78-05c851d88fb7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:14.109230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26620b04-9e8f-48a6-94ed-d8a21ccbcde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:14.110259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26620b04-9e8f-48a6-94ed-d8a21ccbcde5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:14.110746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26620b04-9e8f-48a6-94ed-d8a21ccbcde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:14.111242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26620b04-9e8f-48a6-94ed-d8a21ccbcde5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:14.123398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26620b04-9e8f-48a6-94ed-d8a21ccbcde5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-26620b04-9e8f-48a6-94ed-d8a21ccbcde5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:00:14.128671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:14.129609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:14.130477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:14.132804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 523/1067] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:00:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:00:14.138980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef59a65-ab88-44e0-8c78-8dc1bf29a732 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:14.224672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:14.250190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef59a65-ab88-44e0-8c78-8dc1bf29a732 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:14.292060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03244f49-414c-4ce9-86e2-c4ab721adf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:14.293102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244f49-414c-4ce9-86e2-c4ab721adf9f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:14.293960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244f49-414c-4ce9-86e2-c4ab721adf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:14.294236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244f49-414c-4ce9-86e2-c4ab721adf9f None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:14.294918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03244f49-414c-4ce9-86e2-c4ab721adf9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:14.295219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03244f49-414c-4ce9-86e2-c4ab721adf9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:14.296639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03244f49-414c-4ce9-86e2-c4ab721adf9f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:14.311102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 545/1068] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:14.313510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26620b04-9e8f-48a6-94ed-d8a21ccbcde5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:14.389755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2657-a076-4efb-a3f0-306cd5fbbc5e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:14.390022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2657-a076-4efb-a3f0-306cd5fbbc5e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:14.390364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2657-a076-4efb-a3f0-306cd5fbbc5e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:14.392307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 546/1069] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:00:14.397275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb930370-a942-42b7-9f8f-57c690802d8d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:14.397548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb930370-a942-42b7-9f8f-57c690802d8d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:14.397820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb930370-a942-42b7-9f8f-57c690802d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:14.399132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:14.416300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cb930370-a942-42b7-9f8f-57c690802d8d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:14.417475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cb930370-a942-42b7-9f8f-57c690802d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:14.446862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26620b04-9e8f-48a6-94ed-d8a21ccbcde5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:14.483634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a56f8-aeb5-4bac-8f76-88cd4da0d0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:14.484303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a56f8-aeb5-4bac-8f76-88cd4da0d0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:14.484583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a56f8-aeb5-4bac-8f76-88cd4da0d0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:14.484856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a56f8-aeb5-4bac-8f76-88cd4da0d0b5 None admin] PATH_INFO: `/v3/users/0de8d3052a47494d98004f36c193f9e9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:14.489508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 547/1070] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:00:14.498709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a56f8-aeb5-4bac-8f76-88cd4da0d0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=0de8d3052a47494d98004f36c193f9e9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:14.500183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a56f8-aeb5-4bac-8f76-88cd4da0d0b5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:14.502000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 524/1071] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:14 2022] GET /identity/v3/users/0de8d3052a47494d98004f36c193f9e9 => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:14.508166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb930370-a942-42b7-9f8f-57c690802d8d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:14.589780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:14.621127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb930370-a942-42b7-9f8f-57c690802d8d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:14.660686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531e067-bfac-4341-9db8-dca8d45177b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:14.661294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531e067-bfac-4341-9db8-dca8d45177b0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:14.661573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531e067-bfac-4341-9db8-dca8d45177b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:14.661845 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531e067-bfac-4341-9db8-dca8d45177b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:14.763306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a56f8-aeb5-4bac-8f76-88cd4da0d0b5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:14.789596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531e067-bfac-4341-9db8-dca8d45177b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:14.791064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531e067-bfac-4341-9db8-dca8d45177b0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:14.860868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:14.869249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a56f8-aeb5-4bac-8f76-88cd4da0d0b5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:14.884277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:14.891592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 548/1072] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:00:14.892976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20250c-acab-4350-8a5e-ec38f7e35641 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:14.893263 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20250c-acab-4350-8a5e-ec38f7e35641 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:14.893536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20250c-acab-4350-8a5e-ec38f7e35641 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:14.894814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 549/1073] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:14.897906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20250c-acab-4350-8a5e-ec38f7e35641 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:14.905808 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3508c0e-19d6-4e3d-b169-c79bb4771421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:14.906445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3508c0e-19d6-4e3d-b169-c79bb4771421 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:14.906724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3508c0e-19d6-4e3d-b169-c79bb4771421 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:14.906991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3508c0e-19d6-4e3d-b169-c79bb4771421 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:14.918296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3508c0e-19d6-4e3d-b169-c79bb4771421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-b3508c0e-19d6-4e3d-b169-c79bb4771421 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:00:14.924330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:14.925301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:14.926150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 525/1074] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Aug 31 11:00:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:00:14.927132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933df6b7-e4a1-46c5-81c2-b696780a45ac None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:14.927350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933df6b7-e4a1-46c5-81c2-b696780a45ac None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:14.927658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933df6b7-e4a1-46c5-81c2-b696780a45ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:14.947554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-933df6b7-e4a1-46c5-81c2-b696780a45ac None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:14.948815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-933df6b7-e4a1-46c5-81c2-b696780a45ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:15.008750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20250c-acab-4350-8a5e-ec38f7e35641 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:15.015160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 526/1075] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:15.015956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933df6b7-e4a1-46c5-81c2-b696780a45ac None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.044236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589a9ce-825a-4a5d-83d7-5ee27d34d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:15.045587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589a9ce-825a-4a5d-83d7-5ee27d34d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:15.046002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589a9ce-825a-4a5d-83d7-5ee27d34d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:15.046340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589a9ce-825a-4a5d-83d7-5ee27d34d4a9 None admin] PATH_INFO: `/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:15.047629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589a9ce-825a-4a5d-83d7-5ee27d34d4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=bbb930bcd15446ba8e7f785cbdcd6bb6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:15.049380 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589a9ce-825a-4a5d-83d7-5ee27d34d4a9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:15.056605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 550/1076] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:00:14 2022] GET /identity/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:15.057618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589a9ce-825a-4a5d-83d7-5ee27d34d4a9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.101200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:15.129710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933df6b7-e4a1-46c5-81c2-b696780a45ac None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:15.133519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:15.164386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589a9ce-825a-4a5d-83d7-5ee27d34d4a9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:15.168039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040a80f-9465-4f84-8c25-25f75aa79877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:15.168654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a80f-9465-4f84-8c25-25f75aa79877 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:15.168928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a80f-9465-4f84-8c25-25f75aa79877 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:15.169195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a80f-9465-4f84-8c25-25f75aa79877 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:15.169852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040a80f-9465-4f84-8c25-25f75aa79877 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:15.170978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040a80f-9465-4f84-8c25-25f75aa79877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:15.172454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040a80f-9465-4f84-8c25-25f75aa79877 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:15.183798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 527/1077] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:15.187788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040a80f-9465-4f84-8c25-25f75aa79877 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.203337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5d1e0-e270-4acb-9397-2a2340273ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:15.203969 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d1e0-e270-4acb-9397-2a2340273ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:15.204248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d1e0-e270-4acb-9397-2a2340273ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:15.204522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d1e0-e270-4acb-9397-2a2340273ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:15.205245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5d1e0-e270-4acb-9397-2a2340273ff8 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=bbb930bcd15446ba8e7f785cbdcd6bb6, user.id=0de8d3052a47494d98004f36c193f9e9) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:15.205552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5d1e0-e270-4acb-9397-2a2340273ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:15.206978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5d1e0-e270-4acb-9397-2a2340273ff8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:15.223778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 551/1078] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/role_assignments?user.id=0de8d3052a47494d98004f36c193f9e9&scope.project.id=bbb930bcd15446ba8e7f785cbdcd6bb6&role.id=55aed406476a485f99f9815f9f27cb3b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:15.285899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5d1e0-e270-4acb-9397-2a2340273ff8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.313968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040a80f-9465-4f84-8c25-25f75aa79877 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:15.356414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb323a99-080f-42d3-ad98-51d876dbc1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:15.357063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb323a99-080f-42d3-ad98-51d876dbc1cf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:15.357341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb323a99-080f-42d3-ad98-51d876dbc1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:15.357640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb323a99-080f-42d3-ad98-51d876dbc1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:15.369835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb323a99-080f-42d3-ad98-51d876dbc1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:15.371303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb323a99-080f-42d3-ad98-51d876dbc1cf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-eb323a99-080f-42d3-ad98-51d876dbc1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:00:15.386768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:15.387822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:00:15.389660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:00:15.389660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:15.389660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:15.389660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 528/1079] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:00:15.394782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb323a99-080f-42d3-ad98-51d876dbc1cf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.417248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5d1e0-e270-4acb-9397-2a2340273ff8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:15.419247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:15.421250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:15.454708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014f80d-83df-410f-96a8-38eef5fc0ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:15.455327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f80d-83df-410f-96a8-38eef5fc0ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:15.455600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f80d-83df-410f-96a8-38eef5fc0ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:15.455903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f80d-83df-410f-96a8-38eef5fc0ef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:15.519978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb323a99-080f-42d3-ad98-51d876dbc1cf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:15.528164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014f80d-83df-410f-96a8-38eef5fc0ef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:15.530201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014f80d-83df-410f-96a8-38eef5fc0ef3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:15.568219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7ade2-15b1-4875-a5db-c4166cb79892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:15.568835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7ade2-15b1-4875-a5db-c4166cb79892 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:15.569107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7ade2-15b1-4875-a5db-c4166cb79892 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:15.569382 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7ade2-15b1-4875-a5db-c4166cb79892 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:15.570027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7ade2-15b1-4875-a5db-c4166cb79892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:15.570328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7ade2-15b1-4875-a5db-c4166cb79892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:15.571692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7ade2-15b1-4875-a5db-c4166cb79892 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:15.591139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 529/1080] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:15.592776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7ade2-15b1-4875-a5db-c4166cb79892 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.651432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 552/1081] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 11:00:15.658224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014f80d-83df-410f-96a8-38eef5fc0ef3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.660233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:15.689228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:15.712153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7ade2-15b1-4875-a5db-c4166cb79892 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:15.749687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266c5c2-41c0-45e6-83ef-56795b57979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:15.750318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266c5c2-41c0-45e6-83ef-56795b57979d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:15.750599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266c5c2-41c0-45e6-83ef-56795b57979d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:15.750870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266c5c2-41c0-45e6-83ef-56795b57979d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:15.758927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266c5c2-41c0-45e6-83ef-56795b57979d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:15.760462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266c5c2-41c0-45e6-83ef-56795b57979d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:15.765178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014f80d-83df-410f-96a8-38eef5fc0ef3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3266c5c2-41c0-45e6-83ef-56795b57979d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:00:15.772325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:15.773572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:15.774569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 530/1082] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:00:15.779121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266c5c2-41c0-45e6-83ef-56795b57979d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.809859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38528eb-d727-4f20-980d-7f34d94235ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:15.810778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38528eb-d727-4f20-980d-7f34d94235ed None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:15.811055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38528eb-d727-4f20-980d-7f34d94235ed None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:15.811326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38528eb-d727-4f20-980d-7f34d94235ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:15.825215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38528eb-d727-4f20-980d-7f34d94235ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:15.826938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38528eb-d727-4f20-980d-7f34d94235ed None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d38528eb-d727-4f20-980d-7f34d94235ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:00:15.844669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:15.845685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:00:15.846596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:00:15.846596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:15.846596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:15.846596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 553/1083] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:00:15.851562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38528eb-d727-4f20-980d-7f34d94235ed None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.889624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266c5c2-41c0-45e6-83ef-56795b57979d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:15.910874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:15.926314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26cae2-e4d0-4b9f-a019-0bc099160418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:15.927115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26cae2-e4d0-4b9f-a019-0bc099160418 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:15.927542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26cae2-e4d0-4b9f-a019-0bc099160418 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:15.927996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26cae2-e4d0-4b9f-a019-0bc099160418 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:15.928723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26cae2-e4d0-4b9f-a019-0bc099160418 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:15.929028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26cae2-e4d0-4b9f-a019-0bc099160418 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:15.930711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26cae2-e4d0-4b9f-a019-0bc099160418 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:15.940097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:15.950062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 531/1084] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:15.955993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26cae2-e4d0-4b9f-a019-0bc099160418 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:15.962559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38528eb-d727-4f20-980d-7f34d94235ed None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:16.001983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c809c4-fc50-4997-8109-d4b5e6f58b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:16.002597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c809c4-fc50-4997-8109-d4b5e6f58b1c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:16.002873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c809c4-fc50-4997-8109-d4b5e6f58b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:16.003143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c809c4-fc50-4997-8109-d4b5e6f58b1c None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:16.003835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c809c4-fc50-4997-8109-d4b5e6f58b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:16.004128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c809c4-fc50-4997-8109-d4b5e6f58b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:16.005512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c809c4-fc50-4997-8109-d4b5e6f58b1c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:16.022080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 554/1085] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:16.091578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26cae2-e4d0-4b9f-a019-0bc099160418 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:16.140687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15857c-ece9-42a5-8a30-b24731618736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:16.141528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15857c-ece9-42a5-8a30-b24731618736 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:16.141817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15857c-ece9-42a5-8a30-b24731618736 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:16.142077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15857c-ece9-42a5-8a30-b24731618736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:16.219044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:16.227090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15857c-ece9-42a5-8a30-b24731618736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:16.228562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15857c-ece9-42a5-8a30-b24731618736 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:16.355376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 532/1086] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 11:00:16.361453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c809c4-fc50-4997-8109-d4b5e6f58b1c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:16.469388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c809c4-fc50-4997-8109-d4b5e6f58b1c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:16.485161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:16.513068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d893b5-960c-4d43-81ca-bfad4bbb2d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:16.513729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d893b5-960c-4d43-81ca-bfad4bbb2d20 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:16.514003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d893b5-960c-4d43-81ca-bfad4bbb2d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:16.514390 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d893b5-960c-4d43-81ca-bfad4bbb2d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:16.525667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d893b5-960c-4d43-81ca-bfad4bbb2d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:16.527119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d893b5-960c-4d43-81ca-bfad4bbb2d20 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a8d893b5-960c-4d43-81ca-bfad4bbb2d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:00:16.542625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:16.543668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:00:16.546148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:00:16.546148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:00:16.546148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:16.546148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 555/1087] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:16.550122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15857c-ece9-42a5-8a30-b24731618736 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:16.645454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:16.651157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15857c-ece9-42a5-8a30-b24731618736 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:16.686786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485c04-98ec-4b0f-aae7-551ed6ae5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:16.687390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485c04-98ec-4b0f-aae7-551ed6ae5c80 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:16.687671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485c04-98ec-4b0f-aae7-551ed6ae5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:16.687975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485c04-98ec-4b0f-aae7-551ed6ae5c80 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:16.688621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485c04-98ec-4b0f-aae7-551ed6ae5c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:16.688926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485c04-98ec-4b0f-aae7-551ed6ae5c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:16.690292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485c04-98ec-4b0f-aae7-551ed6ae5c80 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:16.703105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 533/1088] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:16.708718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d893b5-960c-4d43-81ca-bfad4bbb2d20 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:16.821121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d893b5-960c-4d43-81ca-bfad4bbb2d20 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:16.856804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cdb0a-0137-4a20-842b-d96244c002cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:16.857788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cdb0a-0137-4a20-842b-d96244c002cb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:16.858067 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cdb0a-0137-4a20-842b-d96244c002cb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:16.858335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cdb0a-0137-4a20-842b-d96244c002cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:16.865425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cdb0a-0137-4a20-842b-d96244c002cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:16.866884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cdb0a-0137-4a20-842b-d96244c002cb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ab9cdb0a-0137-4a20-842b-d96244c002cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:00:16.878114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:16.879189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:16.880300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:00:16.880300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:00:16.880300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:00:16.880300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:00:16.880300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:00:16.880300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:00:16.880300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:00:16.880300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:16.880300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 556/1089] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:00:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:16.885342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485c04-98ec-4b0f-aae7-551ed6ae5c80 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:16.990036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485c04-98ec-4b0f-aae7-551ed6ae5c80 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.025087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fa0ed-4216-4503-bd1e-aadb63b4b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.025703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fa0ed-4216-4503-bd1e-aadb63b4b2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.025983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fa0ed-4216-4503-bd1e-aadb63b4b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.026255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fa0ed-4216-4503-bd1e-aadb63b4b2b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.026962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fa0ed-4216-4503-bd1e-aadb63b4b2b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:17.027334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fa0ed-4216-4503-bd1e-aadb63b4b2b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.028815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fa0ed-4216-4503-bd1e-aadb63b4b2b1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.042474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 534/1090] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 11:00:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:17.049186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cdb0a-0137-4a20-842b-d96244c002cb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.078157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:17.152663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cdb0a-0137-4a20-842b-d96244c002cb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.170123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaed5d-88e4-4d6c-bcad-5f0c1c7c6ca9 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.170404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaed5d-88e4-4d6c-bcad-5f0c1c7c6ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.170691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaed5d-88e4-4d6c-bcad-5f0c1c7c6ca9 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.172294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 535/1091] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:00:17.177095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b629-0246-4688-9c63-4cbee88d9d42 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.177377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b629-0246-4688-9c63-4cbee88d9d42 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.177653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b629-0246-4688-9c63-4cbee88d9d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.187296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118c6fe-77f6-4f5c-b117-1b9998e58cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.187930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c6fe-77f6-4f5c-b117-1b9998e58cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.188204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c6fe-77f6-4f5c-b117-1b9998e58cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.188467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c6fe-77f6-4f5c-b117-1b9998e58cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.189186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118c6fe-77f6-4f5c-b117-1b9998e58cc6 None admin] RBAC: Adding query filter params (role.id=b26684c206814c398b13a51afde0426d, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=c9c5d8bbcf07486ea3d3e26c81135d2f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:17.189490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118c6fe-77f6-4f5c-b117-1b9998e58cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.190898 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118c6fe-77f6-4f5c-b117-1b9998e58cc6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.196832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-23d0b629-0246-4688-9c63-4cbee88d9d42 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:17.196968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 557/1092] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:00:17 2022] GET /identity/v3/role_assignments?user.id=c9c5d8bbcf07486ea3d3e26c81135d2f&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=b26684c206814c398b13a51afde0426d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:17.198028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-23d0b629-0246-4688-9c63-4cbee88d9d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:17.211626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:17.280827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 536/1093] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:00:17.550488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118c6fe-77f6-4f5c-b117-1b9998e58cc6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.662145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:17.673204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118c6fe-77f6-4f5c-b117-1b9998e58cc6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.712299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdc10e-e86e-4865-811d-c9eca43dd6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.712934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdc10e-e86e-4865-811d-c9eca43dd6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.713205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdc10e-e86e-4865-811d-c9eca43dd6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.713469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdc10e-e86e-4865-811d-c9eca43dd6e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.725723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdc10e-e86e-4865-811d-c9eca43dd6e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-59fdc10e-e86e-4865-811d-c9eca43dd6e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:00:17.730514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:17.731491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:17.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 558/1094] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:00:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:17.737884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0b629-0246-4688-9c63-4cbee88d9d42 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.842591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0b629-0246-4688-9c63-4cbee88d9d42 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.882170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5aea7-fe7f-4a4e-b01f-8290777cf1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.882788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5aea7-fe7f-4a4e-b01f-8290777cf1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.883066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5aea7-fe7f-4a4e-b01f-8290777cf1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.883339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5aea7-fe7f-4a4e-b01f-8290777cf1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.884037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5aea7-fe7f-4a4e-b01f-8290777cf1d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:17.884343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5aea7-fe7f-4a4e-b01f-8290777cf1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.885727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5aea7-fe7f-4a4e-b01f-8290777cf1d6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.895520 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 537/1095] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:00:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:17.902010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdc10e-e86e-4865-811d-c9eca43dd6e5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:18.009618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdc10e-e86e-4865-811d-c9eca43dd6e5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:18.044967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532f36c-dbb8-45d4-8d58-0bb84e1de251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:18.045610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532f36c-dbb8-45d4-8d58-0bb84e1de251 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:18.045890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532f36c-dbb8-45d4-8d58-0bb84e1de251 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:18.046160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532f36c-dbb8-45d4-8d58-0bb84e1de251 None admin] PATH_INFO: `/v3/users/0de8d3052a47494d98004f36c193f9e9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:18.047311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532f36c-dbb8-45d4-8d58-0bb84e1de251 None admin] RBAC: Authorizing `identity:get_user(user_id=0de8d3052a47494d98004f36c193f9e9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:18.048786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532f36c-dbb8-45d4-8d58-0bb84e1de251 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:18.050381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 559/1096] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:17 2022] GET /identity/v3/users/0de8d3052a47494d98004f36c193f9e9 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:18.056537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5aea7-fe7f-4a4e-b01f-8290777cf1d6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:18.069742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:18.161344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5aea7-fe7f-4a4e-b01f-8290777cf1d6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:18.196706 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab4b5-6be0-441f-8b42-fd6bfe5d97f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:18.197327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab4b5-6be0-441f-8b42-fd6bfe5d97f3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:18.197600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab4b5-6be0-441f-8b42-fd6bfe5d97f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:18.197864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab4b5-6be0-441f-8b42-fd6bfe5d97f3 None admin] PATH_INFO: `/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:18.198948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab4b5-6be0-441f-8b42-fd6bfe5d97f3 None admin] RBAC: Authorizing `identity:get_project(project_id=bbb930bcd15446ba8e7f785cbdcd6bb6)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:18.200397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab4b5-6be0-441f-8b42-fd6bfe5d97f3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:18.202287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 538/1097] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:00:18 2022] GET /identity/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:18.208307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532f36c-dbb8-45d4-8d58-0bb84e1de251 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:18.229126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:18.312823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532f36c-dbb8-45d4-8d58-0bb84e1de251 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:18.346295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e72be2-610e-4b06-9c9a-40336dd0d355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:18.346948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e72be2-610e-4b06-9c9a-40336dd0d355 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:18.347224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e72be2-610e-4b06-9c9a-40336dd0d355 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:18.347495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e72be2-610e-4b06-9c9a-40336dd0d355 None admin] PATH_INFO: `/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6/users/0de8d3052a47494d98004f36c193f9e9/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:18.349402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e72be2-610e-4b06-9c9a-40336dd0d355 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbb930bcd15446ba8e7f785cbdcd6bb6, user_id=0de8d3052a47494d98004f36c193f9e9, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:18.350830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e72be2-610e-4b06-9c9a-40336dd0d355 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:18.409148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 560/1098] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 11:00:18 2022] PUT /identity/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6/users/0de8d3052a47494d98004f36c193f9e9/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:20.327695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afb320-b2bb-4354-a7ea-77b8aa031ada None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:20.328234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afb320-b2bb-4354-a7ea-77b8aa031ada None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:20.328234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afb320-b2bb-4354-a7ea-77b8aa031ada None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:20.329583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 539/1099] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:20.334780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ada8-f9cc-42d3-af08-3e6f60067a59 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:20.335202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ada8-f9cc-42d3-af08-3e6f60067a59 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:20.335325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ada8-f9cc-42d3-af08-3e6f60067a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:20.353148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3615ada8-f9cc-42d3-af08-3e6f60067a59 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:20.354324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3615ada8-f9cc-42d3-af08-3e6f60067a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:20.421319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 561/1100] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:20.698991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afb320-b2bb-4354-a7ea-77b8aa031ada None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:20.776695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:20.800388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afb320-b2bb-4354-a7ea-77b8aa031ada None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:20.835512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5807-c273-4f0c-abc7-64c84ceb9df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:20.836172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5807-c273-4f0c-abc7-64c84ceb9df1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:20.836451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5807-c273-4f0c-abc7-64c84ceb9df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:20.836721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5807-c273-4f0c-abc7-64c84ceb9df1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:20.848017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae5807-c273-4f0c-abc7-64c84ceb9df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a9ae5807-c273-4f0c-abc7-64c84ceb9df1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:00:20.854124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:20.855270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:20.856255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:20.856991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 540/1101] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:20.863657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ada8-f9cc-42d3-af08-3e6f60067a59 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:20.875931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:20.989787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ada8-f9cc-42d3-af08-3e6f60067a59 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:21.024389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf65bc-41cd-4e67-b4cb-7348eaeba1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:21.025001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf65bc-41cd-4e67-b4cb-7348eaeba1fc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:21.025279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf65bc-41cd-4e67-b4cb-7348eaeba1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:21.025550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf65bc-41cd-4e67-b4cb-7348eaeba1fc None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:21.026222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf65bc-41cd-4e67-b4cb-7348eaeba1fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:21.026523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf65bc-41cd-4e67-b4cb-7348eaeba1fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:21.027923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf65bc-41cd-4e67-b4cb-7348eaeba1fc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:21.037642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 562/1102] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:00:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:21.044063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5807-c273-4f0c-abc7-64c84ceb9df1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:21.154556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5807-c273-4f0c-abc7-64c84ceb9df1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:21.190196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0149040-de6b-4b22-88e1-9fc33e9ee866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:21.190825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0149040-de6b-4b22-88e1-9fc33e9ee866 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:21.191106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0149040-de6b-4b22-88e1-9fc33e9ee866 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:21.191379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0149040-de6b-4b22-88e1-9fc33e9ee866 None admin] PATH_INFO: `/v3/users/0de8d3052a47494d98004f36c193f9e9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:21.192518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0149040-de6b-4b22-88e1-9fc33e9ee866 None admin] RBAC: Authorizing `identity:get_user(user_id=0de8d3052a47494d98004f36c193f9e9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:21.193955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0149040-de6b-4b22-88e1-9fc33e9ee866 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:21.195553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 541/1103] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:21 2022] GET /identity/v3/users/0de8d3052a47494d98004f36c193f9e9 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:21.202249 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf65bc-41cd-4e67-b4cb-7348eaeba1fc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:21.285859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:21.317273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf65bc-41cd-4e67-b4cb-7348eaeba1fc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:21.349417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f6361-7b6f-4ad4-aff6-0fbfc7e8ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:21.350066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f6361-7b6f-4ad4-aff6-0fbfc7e8ec86 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:21.350272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f6361-7b6f-4ad4-aff6-0fbfc7e8ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:21.350539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f6361-7b6f-4ad4-aff6-0fbfc7e8ec86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:21.415993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f6361-7b6f-4ad4-aff6-0fbfc7e8ec86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:21.417439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f6361-7b6f-4ad4-aff6-0fbfc7e8ec86 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:21.483022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:21.514028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 563/1104] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 11:00:21.519959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0149040-de6b-4b22-88e1-9fc33e9ee866 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:21.523702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:21.621833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0149040-de6b-4b22-88e1-9fc33e9ee866 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:21.654989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420f723-9c2c-460b-b65d-859bfddd697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:21.655600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420f723-9c2c-460b-b65d-859bfddd697c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:21.655905 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420f723-9c2c-460b-b65d-859bfddd697c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:21.656179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420f723-9c2c-460b-b65d-859bfddd697c None admin] PATH_INFO: `/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:21.657281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420f723-9c2c-460b-b65d-859bfddd697c None admin] RBAC: Authorizing `identity:get_project(project_id=bbb930bcd15446ba8e7f785cbdcd6bb6)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:21.658738 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420f723-9c2c-460b-b65d-859bfddd697c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:21.660396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 542/1105] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:00:21 2022] GET /identity/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:21.666639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f6361-7b6f-4ad4-aff6-0fbfc7e8ec86 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:21.765787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f6361-7b6f-4ad4-aff6-0fbfc7e8ec86 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:21.800014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad195180-fed6-4dbc-8678-397dc025d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:21.800620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad195180-fed6-4dbc-8678-397dc025d8ea None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:21.800898 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad195180-fed6-4dbc-8678-397dc025d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:21.801168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad195180-fed6-4dbc-8678-397dc025d8ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:21.801888 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad195180-fed6-4dbc-8678-397dc025d8ea None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=bbb930bcd15446ba8e7f785cbdcd6bb6, user.id=0de8d3052a47494d98004f36c193f9e9) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:21.802192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad195180-fed6-4dbc-8678-397dc025d8ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:21.803606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad195180-fed6-4dbc-8678-397dc025d8ea None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:21.809544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 564/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:00:21 2022] GET /identity/v3/role_assignments?user.id=0de8d3052a47494d98004f36c193f9e9&scope.project.id=bbb930bcd15446ba8e7f785cbdcd6bb6&role.id=55aed406476a485f99f9815f9f27cb3b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:23.791352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a4f98-b69f-4094-a661-f5af6b74d470 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:23.791977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a4f98-b69f-4094-a661-f5af6b74d470 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:23.791977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a4f98-b69f-4094-a661-f5af6b74d470 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:23.793331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 543/1107] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:23.799088 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add31596-bd9c-4e08-a3e6-f7c3f05f7cf7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:23.799497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add31596-bd9c-4e08-a3e6-f7c3f05f7cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:23.799626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add31596-bd9c-4e08-a3e6-f7c3f05f7cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:23.818160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-add31596-bd9c-4e08-a3e6-f7c3f05f7cf7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:23.819335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-add31596-bd9c-4e08-a3e6-f7c3f05f7cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:23.845636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:23.885431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 565/1108] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:24.157369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a4f98-b69f-4094-a661-f5af6b74d470 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:24.228225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:24.259099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a4f98-b69f-4094-a661-f5af6b74d470 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:24.292454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4681744-16fe-40fe-888a-494348c7b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:24.293079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4681744-16fe-40fe-888a-494348c7b69a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:24.293355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4681744-16fe-40fe-888a-494348c7b69a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:24.293624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4681744-16fe-40fe-888a-494348c7b69a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:24.295405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4681744-16fe-40fe-888a-494348c7b69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:24.297005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4681744-16fe-40fe-888a-494348c7b69a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:24.298569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 544/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:24.304282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add31596-bd9c-4e08-a3e6-f7c3f05f7cf7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:24.403208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add31596-bd9c-4e08-a3e6-f7c3f05f7cf7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:24.437665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4dc23-1c42-4874-a74b-8b693dc298e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:24.438194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4dc23-1c42-4874-a74b-8b693dc298e0 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:24.438467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4dc23-1c42-4874-a74b-8b693dc298e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:24.438787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4dc23-1c42-4874-a74b-8b693dc298e0 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:24.439393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4dc23-1c42-4874-a74b-8b693dc298e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:24.440848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4dc23-1c42-4874-a74b-8b693dc298e0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:24.551597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 566/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 11:00:24 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:26.521252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aef664-1816-4582-adaf-d9a34b25e833 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:26.521805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aef664-1816-4582-adaf-d9a34b25e833 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:26.521805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aef664-1816-4582-adaf-d9a34b25e833 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:26.523128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 545/1111] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:26.528376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2e6b2-9a41-4b4a-b2f0-6357ad7bb9b5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:26.528772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2e6b2-9a41-4b4a-b2f0-6357ad7bb9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:26.528951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2e6b2-9a41-4b4a-b2f0-6357ad7bb9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:26.547957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-44e2e6b2-9a41-4b4a-b2f0-6357ad7bb9b5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:26.549045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-44e2e6b2-9a41-4b4a-b2f0-6357ad7bb9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:26.563996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:26.615883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 567/1112] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:26.891621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aef664-1816-4582-adaf-d9a34b25e833 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:26.999210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aef664-1816-4582-adaf-d9a34b25e833 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:27.032426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac4508-36e4-4fcc-8a65-46652643f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:27.033041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac4508-36e4-4fcc-8a65-46652643f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:27.033316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac4508-36e4-4fcc-8a65-46652643f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:27.033584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac4508-36e4-4fcc-8a65-46652643f6a9 None admin] PATH_INFO: `/v3/roles/ff90bae50e0644739e4bdec7431da2e0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:27.034956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac4508-36e4-4fcc-8a65-46652643f6a9 None admin] RBAC: Authorizing `identity:get_role(role_id=ff90bae50e0644739e4bdec7431da2e0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:27.036346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac4508-36e4-4fcc-8a65-46652643f6a9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:27.037671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 546/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:26 2022] GET /identity/v3/roles/ff90bae50e0644739e4bdec7431da2e0 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:27.043510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2e6b2-9a41-4b4a-b2f0-6357ad7bb9b5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:27.143054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2e6b2-9a41-4b4a-b2f0-6357ad7bb9b5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:27.177231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393119c-7501-410e-92a8-184ed27e1f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:27.177849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393119c-7501-410e-92a8-184ed27e1f4c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:27.178128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393119c-7501-410e-92a8-184ed27e1f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:27.178392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393119c-7501-410e-92a8-184ed27e1f4c None admin] PATH_INFO: `/v3/users/e7723a14213340938d01cad07a27948c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:27.193690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393119c-7501-410e-92a8-184ed27e1f4c None admin] RBAC: Authorizing `identity:get_user(user_id=e7723a14213340938d01cad07a27948c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:27.195139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393119c-7501-410e-92a8-184ed27e1f4c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:27.196847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 568/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:27 2022] GET /identity/v3/users/e7723a14213340938d01cad07a27948c => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:27.206646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac4508-36e4-4fcc-8a65-46652643f6a9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:27.217804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:27.306234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac4508-36e4-4fcc-8a65-46652643f6a9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:27.339448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db27ee-6aeb-42a3-b0a2-64d0dbbcc508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:27.340072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db27ee-6aeb-42a3-b0a2-64d0dbbcc508 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:27.340350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db27ee-6aeb-42a3-b0a2-64d0dbbcc508 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:27.340622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db27ee-6aeb-42a3-b0a2-64d0dbbcc508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:27.405890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db27ee-6aeb-42a3-b0a2-64d0dbbcc508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:27.407252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db27ee-6aeb-42a3-b0a2-64d0dbbcc508 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:27.416629 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:27.504043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 547/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:00:27.510160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393119c-7501-410e-92a8-184ed27e1f4c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:27.521116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:27.619226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393119c-7501-410e-92a8-184ed27e1f4c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:27.652445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d7518-c1b7-4cdd-b458-f543aec3769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:27.653073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d7518-c1b7-4cdd-b458-f543aec3769e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:27.653347 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d7518-c1b7-4cdd-b458-f543aec3769e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:27.653614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d7518-c1b7-4cdd-b458-f543aec3769e None admin] PATH_INFO: `/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:27.655292 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d7518-c1b7-4cdd-b458-f543aec3769e None admin] RBAC: Authorizing `identity:get_project(project_id=bbb930bcd15446ba8e7f785cbdcd6bb6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:27.656823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d7518-c1b7-4cdd-b458-f543aec3769e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:27.658405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 569/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:00:27 2022] GET /identity/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:27.665484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db27ee-6aeb-42a3-b0a2-64d0dbbcc508 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:27.770225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db27ee-6aeb-42a3-b0a2-64d0dbbcc508 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:27.781337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:27.806437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635457b-bca8-4050-bc2a-714fdaabfa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:27.807035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635457b-bca8-4050-bc2a-714fdaabfa4a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:27.807313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635457b-bca8-4050-bc2a-714fdaabfa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:27.807582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635457b-bca8-4050-bc2a-714fdaabfa4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:27.808335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635457b-bca8-4050-bc2a-714fdaabfa4a None admin] RBAC: Adding query filter params (role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=bbb930bcd15446ba8e7f785cbdcd6bb6, user.id=e7723a14213340938d01cad07a27948c) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:27.808636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635457b-bca8-4050-bc2a-714fdaabfa4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:27.810098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635457b-bca8-4050-bc2a-714fdaabfa4a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:27.815917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 548/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:00:27 2022] GET /identity/v3/role_assignments?user.id=e7723a14213340938d01cad07a27948c&scope.project.id=bbb930bcd15446ba8e7f785cbdcd6bb6&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:29.752494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef52827-ea36-46cc-9197-263dd70b630c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:29.753028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef52827-ea36-46cc-9197-263dd70b630c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:29.753028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef52827-ea36-46cc-9197-263dd70b630c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:29.754396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 570/1118] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:29.759427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb4b5-1370-441b-b194-fa83f7aae00e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:29.759888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb4b5-1370-441b-b194-fa83f7aae00e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:29.759990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb4b5-1370-441b-b194-fa83f7aae00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:29.778208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-559eb4b5-1370-441b-b194-fa83f7aae00e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:29.779412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-559eb4b5-1370-441b-b194-fa83f7aae00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:29.846859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 549/1119] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:30.121537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef52827-ea36-46cc-9197-263dd70b630c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:30.202515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:30.226089 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef52827-ea36-46cc-9197-263dd70b630c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:30.262115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420225b-3d80-4d79-8537-18b8f59f504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:30.262749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420225b-3d80-4d79-8537-18b8f59f504e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:30.263026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420225b-3d80-4d79-8537-18b8f59f504e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:30.263478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420225b-3d80-4d79-8537-18b8f59f504e None admin] PATH_INFO: `/v3/roles/ff90bae50e0644739e4bdec7431da2e0` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:30.265205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420225b-3d80-4d79-8537-18b8f59f504e None admin] RBAC: Authorizing `identity:get_role(role_id=ff90bae50e0644739e4bdec7431da2e0)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:30.266586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420225b-3d80-4d79-8537-18b8f59f504e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:30.267954 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 571/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:30 2022] GET /identity/v3/roles/ff90bae50e0644739e4bdec7431da2e0 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:30.273841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eb4b5-1370-441b-b194-fa83f7aae00e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:30.377124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eb4b5-1370-441b-b194-fa83f7aae00e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:30.378618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:30.426320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174c3a7-c30e-4894-88b8-995ff56075ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:30.427386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c3a7-c30e-4894-88b8-995ff56075ff None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:30.427915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c3a7-c30e-4894-88b8-995ff56075ff None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:30.428410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c3a7-c30e-4894-88b8-995ff56075ff None admin] PATH_INFO: `/v3/users/e7723a14213340938d01cad07a27948c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:30.430490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174c3a7-c30e-4894-88b8-995ff56075ff None admin] RBAC: Authorizing `identity:get_user(user_id=e7723a14213340938d01cad07a27948c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:30.433102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174c3a7-c30e-4894-88b8-995ff56075ff None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:30.436663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 550/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:30 2022] GET /identity/v3/users/e7723a14213340938d01cad07a27948c => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:30.442414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420225b-3d80-4d79-8537-18b8f59f504e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:30.544243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420225b-3d80-4d79-8537-18b8f59f504e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:30.580193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed8dcf-8fde-4b1c-bb02-eadabf9c8f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:30.580816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8dcf-8fde-4b1c-bb02-eadabf9c8f27 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:30.581092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8dcf-8fde-4b1c-bb02-eadabf9c8f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:30.581367 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8dcf-8fde-4b1c-bb02-eadabf9c8f27 None admin] PATH_INFO: `/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:30.582497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed8dcf-8fde-4b1c-bb02-eadabf9c8f27 None admin] RBAC: Authorizing `identity:get_project(project_id=bbb930bcd15446ba8e7f785cbdcd6bb6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:30.583951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed8dcf-8fde-4b1c-bb02-eadabf9c8f27 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:30.585600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 572/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:00:30 2022] GET /identity/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:30.592211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174c3a7-c30e-4894-88b8-995ff56075ff None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:30.692107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174c3a7-c30e-4894-88b8-995ff56075ff None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:30.726285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae3159-0e9e-4c69-8d4b-2cb071d6f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:30.726926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae3159-0e9e-4c69-8d4b-2cb071d6f8fa None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:30.727201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae3159-0e9e-4c69-8d4b-2cb071d6f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:30.727471 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae3159-0e9e-4c69-8d4b-2cb071d6f8fa None admin] PATH_INFO: `/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6/users/e7723a14213340938d01cad07a27948c/roles/ff90bae50e0644739e4bdec7431da2e0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:30.729593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae3159-0e9e-4c69-8d4b-2cb071d6f8fa None admin] RBAC: Authorizing `identity:create_grant(project_id=bbb930bcd15446ba8e7f785cbdcd6bb6, user_id=e7723a14213340938d01cad07a27948c, role_id=ff90bae50e0644739e4bdec7431da2e0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:30.731007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae3159-0e9e-4c69-8d4b-2cb071d6f8fa None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:30.848775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 551/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 11:00:30 2022] PUT /identity/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6/users/e7723a14213340938d01cad07a27948c/roles/ff90bae50e0644739e4bdec7431da2e0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:32.975461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e250a39-65a2-43fa-b11d-82214c188663 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:32.976151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e250a39-65a2-43fa-b11d-82214c188663 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:32.976151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e250a39-65a2-43fa-b11d-82214c188663 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:32.977374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 573/1124] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:32.982800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c98dc-264d-41ab-afde-6cfe61533c24 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:32.983297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c98dc-264d-41ab-afde-6cfe61533c24 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:32.983428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c98dc-264d-41ab-afde-6cfe61533c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:33.002806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8b7c98dc-264d-41ab-afde-6cfe61533c24 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:33.004047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8b7c98dc-264d-41ab-afde-6cfe61533c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:33.028862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:33.084734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 552/1125] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:33.359637 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e250a39-65a2-43fa-b11d-82214c188663 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:33.374924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:33.465814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e250a39-65a2-43fa-b11d-82214c188663 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:33.500689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5419e4a-89e9-4df7-afd6-545a644977ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:33.501323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5419e4a-89e9-4df7-afd6-545a644977ff None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:33.501601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5419e4a-89e9-4df7-afd6-545a644977ff None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:33.501873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5419e4a-89e9-4df7-afd6-545a644977ff None admin] PATH_INFO: `/v3/roles/ff90bae50e0644739e4bdec7431da2e0` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:33.503257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5419e4a-89e9-4df7-afd6-545a644977ff None admin] RBAC: Authorizing `identity:get_role(role_id=ff90bae50e0644739e4bdec7431da2e0)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:33.504663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5419e4a-89e9-4df7-afd6-545a644977ff None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:33.505997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 574/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:33 2022] GET /identity/v3/roles/ff90bae50e0644739e4bdec7431da2e0 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:33.511951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c98dc-264d-41ab-afde-6cfe61533c24 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:33.613745 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c98dc-264d-41ab-afde-6cfe61533c24 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:33.648228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c65de-d0ed-4d44-b235-57d526c2de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:33.648854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c65de-d0ed-4d44-b235-57d526c2de78 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:33.649132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c65de-d0ed-4d44-b235-57d526c2de78 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:33.649403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c65de-d0ed-4d44-b235-57d526c2de78 None admin] PATH_INFO: `/v3/users/e7723a14213340938d01cad07a27948c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:33.650537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c65de-d0ed-4d44-b235-57d526c2de78 None admin] RBAC: Authorizing `identity:get_user(user_id=e7723a14213340938d01cad07a27948c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:33.652067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c65de-d0ed-4d44-b235-57d526c2de78 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:33.654298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 553/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:33 2022] GET /identity/v3/users/e7723a14213340938d01cad07a27948c => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:33.660193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5419e4a-89e9-4df7-afd6-545a644977ff None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:33.740546 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:33.759398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5419e4a-89e9-4df7-afd6-545a644977ff None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:33.793081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2178b-b5bc-47b8-8460-9ae36b42436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:33.793675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2178b-b5bc-47b8-8460-9ae36b42436f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:33.793945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2178b-b5bc-47b8-8460-9ae36b42436f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:33.794284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2178b-b5bc-47b8-8460-9ae36b42436f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:33.863404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2178b-b5bc-47b8-8460-9ae36b42436f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:33.865186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2178b-b5bc-47b8-8460-9ae36b42436f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:33.946606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:33.965380 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 575/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:00:33.972082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c65de-d0ed-4d44-b235-57d526c2de78 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:34.000612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:34.072778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c65de-d0ed-4d44-b235-57d526c2de78 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:34.121062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21de53c-b988-4e83-9d5a-f18c04b4cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:34.121589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21de53c-b988-4e83-9d5a-f18c04b4cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:34.121863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21de53c-b988-4e83-9d5a-f18c04b4cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:34.122130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21de53c-b988-4e83-9d5a-f18c04b4cdc3 None admin] PATH_INFO: `/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:34.123247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21de53c-b988-4e83-9d5a-f18c04b4cdc3 None admin] RBAC: Authorizing `identity:get_project(project_id=bbb930bcd15446ba8e7f785cbdcd6bb6)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:34.124697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21de53c-b988-4e83-9d5a-f18c04b4cdc3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:34.126321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 554/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:00:33 2022] GET /identity/v3/projects/bbb930bcd15446ba8e7f785cbdcd6bb6 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:34.132613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2178b-b5bc-47b8-8460-9ae36b42436f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:34.233697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2178b-b5bc-47b8-8460-9ae36b42436f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:34.267526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2deba-d625-4894-b3be-eb8ad48fe9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:34.268160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2deba-d625-4894-b3be-eb8ad48fe9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:34.268435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2deba-d625-4894-b3be-eb8ad48fe9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:34.268702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2deba-d625-4894-b3be-eb8ad48fe9f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:34.269413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2deba-d625-4894-b3be-eb8ad48fe9f7 None admin] RBAC: Adding query filter params (role.id=ff90bae50e0644739e4bdec7431da2e0, scope.project.id=bbb930bcd15446ba8e7f785cbdcd6bb6, user.id=e7723a14213340938d01cad07a27948c) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:34.269715 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2deba-d625-4894-b3be-eb8ad48fe9f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:34.271122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2deba-d625-4894-b3be-eb8ad48fe9f7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:34.276690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 576/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:00:34 2022] GET /identity/v3/role_assignments?user.id=e7723a14213340938d01cad07a27948c&scope.project.id=bbb930bcd15446ba8e7f785cbdcd6bb6&role.id=ff90bae50e0644739e4bdec7431da2e0 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:36.251484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6137c22-48bf-4205-b24f-8473c5481881 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:36.252065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6137c22-48bf-4205-b24f-8473c5481881 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:36.252065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6137c22-48bf-4205-b24f-8473c5481881 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:36.253402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 555/1131] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:36.258437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79149-e7fc-4ca1-9bf9-da7d6f84f649 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:36.258874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79149-e7fc-4ca1-9bf9-da7d6f84f649 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:36.258977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df79149-e7fc-4ca1-9bf9-da7d6f84f649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:36.277254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5df79149-e7fc-4ca1-9bf9-da7d6f84f649 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:36.278464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5df79149-e7fc-4ca1-9bf9-da7d6f84f649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:36.318989 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:36.344844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 577/1132] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:36.627057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6137c22-48bf-4205-b24f-8473c5481881 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:36.721208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:36.727872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6137c22-48bf-4205-b24f-8473c5481881 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:36.762236 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e1945-4926-4ed1-948a-3ca312d0ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:36.762883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1945-4926-4ed1-948a-3ca312d0ad96 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:36.763159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1945-4926-4ed1-948a-3ca312d0ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:36.763424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1945-4926-4ed1-948a-3ca312d0ad96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:36.764637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1945-4926-4ed1-948a-3ca312d0ad96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:36.766065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1945-4926-4ed1-948a-3ca312d0ad96 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:36.767622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 556/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:36.773512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79149-e7fc-4ca1-9bf9-da7d6f84f649 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:36.876595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df79149-e7fc-4ca1-9bf9-da7d6f84f649 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:36.911223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fce09-8827-4f37-893c-a4d60f2b198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:36.911785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fce09-8827-4f37-893c-a4d60f2b198e None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:36.912063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fce09-8827-4f37-893c-a4d60f2b198e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:36.912327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fce09-8827-4f37-893c-a4d60f2b198e None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:36.912965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fce09-8827-4f37-893c-a4d60f2b198e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:36.914391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fce09-8827-4f37-893c-a4d60f2b198e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:37.031429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 578/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 11:00:36 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:39.015709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0313f-6755-4320-b286-1ac085a98e1e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.016321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0313f-6755-4320-b286-1ac085a98e1e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.016321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0313f-6755-4320-b286-1ac085a98e1e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.017709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 557/1135] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:39.024012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eb6f9-f37a-42d1-a587-6f2fd76a13a3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.024503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eb6f9-f37a-42d1-a587-6f2fd76a13a3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.024615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eb6f9-f37a-42d1-a587-6f2fd76a13a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.052265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9c0eb6f9-f37a-42d1-a587-6f2fd76a13a3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:39.053509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9c0eb6f9-f37a-42d1-a587-6f2fd76a13a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:39.082882 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:39.141655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 579/1136] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:39.433084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0313f-6755-4320-b286-1ac085a98e1e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.561990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0313f-6755-4320-b286-1ac085a98e1e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.598510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9f251-fce1-4ecf-9726-b11c21f91669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.599136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9f251-fce1-4ecf-9726-b11c21f91669 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.599413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9f251-fce1-4ecf-9726-b11c21f91669 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.599685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9f251-fce1-4ecf-9726-b11c21f91669 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.600969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9f251-fce1-4ecf-9726-b11c21f91669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.602823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9f251-fce1-4ecf-9726-b11c21f91669 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.604434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 558/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:00:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:39.611247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eb6f9-f37a-42d1-a587-6f2fd76a13a3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:39.723514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eb6f9-f37a-42d1-a587-6f2fd76a13a3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:39.760400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736f2bd-1e73-48bf-a905-e7d75208c0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:39.761134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736f2bd-1e73-48bf-a905-e7d75208c0c9 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:39.761409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736f2bd-1e73-48bf-a905-e7d75208c0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:39.761677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736f2bd-1e73-48bf-a905-e7d75208c0c9 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:39.762338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736f2bd-1e73-48bf-a905-e7d75208c0c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:39.764085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736f2bd-1e73-48bf-a905-e7d75208c0c9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:39.860477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 580/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 11:00:39 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:41.883621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1dad9-4c37-413d-aef3-81a89987d6c5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:41.884248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1dad9-4c37-413d-aef3-81a89987d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:41.884248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1dad9-4c37-413d-aef3-81a89987d6c5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:41.885515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 559/1139] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:41.891363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb1fa-a15f-413a-84eb-60b7029a7b05 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:41.891831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb1fa-a15f-413a-84eb-60b7029a7b05 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:41.892001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb1fa-a15f-413a-84eb-60b7029a7b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:41.911689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b6ceb1fa-a15f-413a-84eb-60b7029a7b05 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:41.912906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b6ceb1fa-a15f-413a-84eb-60b7029a7b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:41.920466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:41.985037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 581/1140] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:42.261910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1dad9-4c37-413d-aef3-81a89987d6c5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:42.293648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:42.365891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1dad9-4c37-413d-aef3-81a89987d6c5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:42.400914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf02f50-6fab-4394-af35-7a33fa75aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:42.401571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf02f50-6fab-4394-af35-7a33fa75aaac None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:42.401842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf02f50-6fab-4394-af35-7a33fa75aaac None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:42.402113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf02f50-6fab-4394-af35-7a33fa75aaac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:42.412931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf02f50-6fab-4394-af35-7a33fa75aaac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-fcf02f50-6fab-4394-af35-7a33fa75aaac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:00:42.417962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:42.420328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:42.421290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 560/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:42.425856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceb1fa-a15f-413a-84eb-60b7029a7b05 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:42.532561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceb1fa-a15f-413a-84eb-60b7029a7b05 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:42.571508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37924aac-885b-43f1-acfd-8df9ebdec9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:42.572138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37924aac-885b-43f1-acfd-8df9ebdec9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:42.572411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37924aac-885b-43f1-acfd-8df9ebdec9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:42.572682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37924aac-885b-43f1-acfd-8df9ebdec9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:42.573381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37924aac-885b-43f1-acfd-8df9ebdec9c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:42.573680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37924aac-885b-43f1-acfd-8df9ebdec9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:42.575328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37924aac-885b-43f1-acfd-8df9ebdec9c3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:42.584749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 582/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:42.591420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf02f50-6fab-4394-af35-7a33fa75aaac None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:42.700891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:42.711795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf02f50-6fab-4394-af35-7a33fa75aaac None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:42.754027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5e115-4804-4ddf-8673-f72a96d8941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:42.754658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e115-4804-4ddf-8673-f72a96d8941b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:42.754938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e115-4804-4ddf-8673-f72a96d8941b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:42.755211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e115-4804-4ddf-8673-f72a96d8941b None admin] PATH_INFO: `/v3/users/bcbbdc2b78b9406ba6ced602a79570eb` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:42.768962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5e115-4804-4ddf-8673-f72a96d8941b None admin] RBAC: Authorizing `identity:get_user(user_id=bcbbdc2b78b9406ba6ced602a79570eb)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:42.770417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5e115-4804-4ddf-8673-f72a96d8941b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:42.772476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 561/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:42 2022] GET /identity/v3/users/bcbbdc2b78b9406ba6ced602a79570eb => generated 286 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:42.779015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37924aac-885b-43f1-acfd-8df9ebdec9c3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:42.783556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:42.888821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37924aac-885b-43f1-acfd-8df9ebdec9c3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:42.927050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e079941-32c7-4623-bbb5-8cb8ce773e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:42.928118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e079941-32c7-4623-bbb5-8cb8ce773e4d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:42.928594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e079941-32c7-4623-bbb5-8cb8ce773e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:42.929054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e079941-32c7-4623-bbb5-8cb8ce773e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:43.007593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e079941-32c7-4623-bbb5-8cb8ce773e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:43.009102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e079941-32c7-4623-bbb5-8cb8ce773e4d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:43.011963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:43.115101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 583/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:00:43.123391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5e115-4804-4ddf-8673-f72a96d8941b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:43.246328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5e115-4804-4ddf-8673-f72a96d8941b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:43.285228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77959-3134-4a0a-9fb0-fa6c1e938e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:43.285852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77959-3134-4a0a-9fb0-fa6c1e938e6f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:43.286125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77959-3134-4a0a-9fb0-fa6c1e938e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:43.286392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77959-3134-4a0a-9fb0-fa6c1e938e6f None admin] PATH_INFO: `/v3/projects/91e44ad1ba15473d83fc2255185bfdce` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:43.287496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd77959-3134-4a0a-9fb0-fa6c1e938e6f None admin] RBAC: Authorizing `identity:get_project(project_id=91e44ad1ba15473d83fc2255185bfdce)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:43.288950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd77959-3134-4a0a-9fb0-fa6c1e938e6f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:43.290565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 562/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:00:43 2022] GET /identity/v3/projects/91e44ad1ba15473d83fc2255185bfdce => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:43.297654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e079941-32c7-4623-bbb5-8cb8ce773e4d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:43.417654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e079941-32c7-4623-bbb5-8cb8ce773e4d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:43.421022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:43.457657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95c1d2-af22-4182-a7c2-96670dc70792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:43.458259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c1d2-af22-4182-a7c2-96670dc70792 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:43.458558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c1d2-af22-4182-a7c2-96670dc70792 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:43.458825 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c1d2-af22-4182-a7c2-96670dc70792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:43.459541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95c1d2-af22-4182-a7c2-96670dc70792 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=91e44ad1ba15473d83fc2255185bfdce, user.id=bcbbdc2b78b9406ba6ced602a79570eb) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:43.459873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95c1d2-af22-4182-a7c2-96670dc70792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:43.461289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95c1d2-af22-4182-a7c2-96670dc70792 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:43.467354 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 584/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:00:43 2022] GET /identity/v3/role_assignments?user.id=bcbbdc2b78b9406ba6ced602a79570eb&scope.project.id=91e44ad1ba15473d83fc2255185bfdce&role.id=55aed406476a485f99f9815f9f27cb3b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:45.759696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f97a-2a3a-4707-a126-9902610e9bd5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:45.760449 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f97a-2a3a-4707-a126-9902610e9bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:45.760449 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f97a-2a3a-4707-a126-9902610e9bd5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:45.761646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 563/1147] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:45.767224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb272d1-9a53-447b-8e7b-14eb1df07daf None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:45.767671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb272d1-9a53-447b-8e7b-14eb1df07daf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:45.767795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb272d1-9a53-447b-8e7b-14eb1df07daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:45.786371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-eeb272d1-9a53-447b-8e7b-14eb1df07daf None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:45.787557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eeb272d1-9a53-447b-8e7b-14eb1df07daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:45.854222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 585/1148] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:46.156995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f97a-2a3a-4707-a126-9902610e9bd5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:46.175939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:46.265818 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f97a-2a3a-4707-a126-9902610e9bd5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:46.304179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ebe7c-3686-421f-ad06-7701fb8f3f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:46.304844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ebe7c-3686-421f-ad06-7701fb8f3f62 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:46.305381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ebe7c-3686-421f-ad06-7701fb8f3f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:46.305653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ebe7c-3686-421f-ad06-7701fb8f3f62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:46.316466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ebe7c-3686-421f-ad06-7701fb8f3f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-5d1ebe7c-3686-421f-ad06-7701fb8f3f62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:00:46.321259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:46.322353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:46.323576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 564/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:46.330033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb272d1-9a53-447b-8e7b-14eb1df07daf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:46.429477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:46.433214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb272d1-9a53-447b-8e7b-14eb1df07daf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:46.474470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce52a8-aed7-4516-9bc3-32de91b9e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:46.475070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce52a8-aed7-4516-9bc3-32de91b9e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:46.475342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce52a8-aed7-4516-9bc3-32de91b9e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:46.475714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce52a8-aed7-4516-9bc3-32de91b9e2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:46.476325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce52a8-aed7-4516-9bc3-32de91b9e2e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:46.476622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce52a8-aed7-4516-9bc3-32de91b9e2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:46.477986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce52a8-aed7-4516-9bc3-32de91b9e2e3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:46.487013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 586/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:46.492666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ebe7c-3686-421f-ad06-7701fb8f3f62 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:46.576057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:46.597559 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ebe7c-3686-421f-ad06-7701fb8f3f62 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:46.632751 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22677c-1814-42df-b2cd-e613d8146db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:46.633373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22677c-1814-42df-b2cd-e613d8146db7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:46.633651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22677c-1814-42df-b2cd-e613d8146db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:46.633920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22677c-1814-42df-b2cd-e613d8146db7 None admin] PATH_INFO: `/v3/users/bcbbdc2b78b9406ba6ced602a79570eb` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:46.635043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22677c-1814-42df-b2cd-e613d8146db7 None admin] RBAC: Authorizing `identity:get_user(user_id=bcbbdc2b78b9406ba6ced602a79570eb)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:46.636493 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22677c-1814-42df-b2cd-e613d8146db7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:46.638839 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 565/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:46 2022] GET /identity/v3/users/bcbbdc2b78b9406ba6ced602a79570eb => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:46.644839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce52a8-aed7-4516-9bc3-32de91b9e2e3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:46.748443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce52a8-aed7-4516-9bc3-32de91b9e2e3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:46.783763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0aed4-796d-4b14-bf22-26cb91c0d1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:46.784506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0aed4-796d-4b14-bf22-26cb91c0d1ad None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:46.784772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0aed4-796d-4b14-bf22-26cb91c0d1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:46.785045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0aed4-796d-4b14-bf22-26cb91c0d1ad None admin] PATH_INFO: `/v3/projects/91e44ad1ba15473d83fc2255185bfdce` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:46.786170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0aed4-796d-4b14-bf22-26cb91c0d1ad None admin] RBAC: Authorizing `identity:get_project(project_id=91e44ad1ba15473d83fc2255185bfdce)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:46.787607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0aed4-796d-4b14-bf22-26cb91c0d1ad None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:46.789293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 587/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:00:46 2022] GET /identity/v3/projects/91e44ad1ba15473d83fc2255185bfdce => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:46.795336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22677c-1814-42df-b2cd-e613d8146db7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:46.955454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22677c-1814-42df-b2cd-e613d8146db7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:47.002682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d5c78-9a98-4dba-bf19-13d049a0e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:47.003260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d5c78-9a98-4dba-bf19-13d049a0e9c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:47.003542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d5c78-9a98-4dba-bf19-13d049a0e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:47.003844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d5c78-9a98-4dba-bf19-13d049a0e9c7 None admin] PATH_INFO: `/v3/projects/91e44ad1ba15473d83fc2255185bfdce/users/bcbbdc2b78b9406ba6ced602a79570eb/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:47.005744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d5c78-9a98-4dba-bf19-13d049a0e9c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=91e44ad1ba15473d83fc2255185bfdce, user_id=bcbbdc2b78b9406ba6ced602a79570eb, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:47.007172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d5c78-9a98-4dba-bf19-13d049a0e9c7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:47.116660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 566/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 11:00:46 2022] PUT /identity/v3/projects/91e44ad1ba15473d83fc2255185bfdce/users/bcbbdc2b78b9406ba6ced602a79570eb/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:49.073835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfc07d-5db5-4a59-b466-dfbb27d9d828 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:49.074424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfc07d-5db5-4a59-b466-dfbb27d9d828 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:49.074424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfc07d-5db5-4a59-b466-dfbb27d9d828 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:49.076365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 588/1154] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:49.081960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf45d7-6442-47f4-9065-5a312981fdad None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:49.082441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf45d7-6442-47f4-9065-5a312981fdad None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:49.082561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf45d7-6442-47f4-9065-5a312981fdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:49.095788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:49.101932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e0cf45d7-6442-47f4-9065-5a312981fdad None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:49.103310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e0cf45d7-6442-47f4-9065-5a312981fdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:49.172397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 567/1155] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:49.444605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfc07d-5db5-4a59-b466-dfbb27d9d828 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:49.474097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:49.549752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfc07d-5db5-4a59-b466-dfbb27d9d828 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:49.585070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc775c-6883-4313-b564-cf0f5add5a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:49.585696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc775c-6883-4313-b564-cf0f5add5a0a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:49.585973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc775c-6883-4313-b564-cf0f5add5a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:49.586243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc775c-6883-4313-b564-cf0f5add5a0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:49.596803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc775c-6883-4313-b564-cf0f5add5a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-01bc775c-6883-4313-b564-cf0f5add5a0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:00:49.601551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:49.602664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:00:49.603878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 589/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:49.609034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf45d7-6442-47f4-9065-5a312981fdad None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:49.715912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf45d7-6442-47f4-9065-5a312981fdad None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:49.751335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd5ff-d49e-4f0d-9a0b-a8b20b8b2004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:49.751970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd5ff-d49e-4f0d-9a0b-a8b20b8b2004 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:49.752247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd5ff-d49e-4f0d-9a0b-a8b20b8b2004 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:49.752523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd5ff-d49e-4f0d-9a0b-a8b20b8b2004 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:49.753205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdd5ff-d49e-4f0d-9a0b-a8b20b8b2004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:49.753507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdd5ff-d49e-4f0d-9a0b-a8b20b8b2004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:49.754876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdd5ff-d49e-4f0d-9a0b-a8b20b8b2004 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:49.757312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:49.764229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 568/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:49.770151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc775c-6883-4313-b564-cf0f5add5a0a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:49.860094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:49.872821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc775c-6883-4313-b564-cf0f5add5a0a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:49.906996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc550725-1147-427f-8ec2-c8e8264bfe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:49.907629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc550725-1147-427f-8ec2-c8e8264bfe8e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:49.907953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc550725-1147-427f-8ec2-c8e8264bfe8e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:49.908223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc550725-1147-427f-8ec2-c8e8264bfe8e None admin] PATH_INFO: `/v3/users/bcbbdc2b78b9406ba6ced602a79570eb` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:49.909361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc550725-1147-427f-8ec2-c8e8264bfe8e None admin] RBAC: Authorizing `identity:get_user(user_id=bcbbdc2b78b9406ba6ced602a79570eb)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:49.910946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc550725-1147-427f-8ec2-c8e8264bfe8e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:49.915584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 590/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:00:49 2022] GET /identity/v3/users/bcbbdc2b78b9406ba6ced602a79570eb => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:49.919143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd5ff-d49e-4f0d-9a0b-a8b20b8b2004 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:50.025893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd5ff-d49e-4f0d-9a0b-a8b20b8b2004 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:50.061787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ede87-9e2b-41db-8182-90fdd1e1f417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:50.062394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ede87-9e2b-41db-8182-90fdd1e1f417 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:50.062676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ede87-9e2b-41db-8182-90fdd1e1f417 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:50.062945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ede87-9e2b-41db-8182-90fdd1e1f417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:50.146058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:50.151524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ede87-9e2b-41db-8182-90fdd1e1f417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:50.154687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ede87-9e2b-41db-8182-90fdd1e1f417 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:50.276104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 569/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:00:50.283133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc550725-1147-427f-8ec2-c8e8264bfe8e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:50.392436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc550725-1147-427f-8ec2-c8e8264bfe8e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:50.428177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8673b-b324-4db2-896c-555dfb23dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:50.428804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8673b-b324-4db2-896c-555dfb23dc68 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:50.429081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8673b-b324-4db2-896c-555dfb23dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:50.429353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8673b-b324-4db2-896c-555dfb23dc68 None admin] PATH_INFO: `/v3/projects/91e44ad1ba15473d83fc2255185bfdce` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:50.430741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8673b-b324-4db2-896c-555dfb23dc68 None admin] RBAC: Authorizing `identity:get_project(project_id=91e44ad1ba15473d83fc2255185bfdce)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:50.432208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8673b-b324-4db2-896c-555dfb23dc68 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:50.433868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 591/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:00:50 2022] GET /identity/v3/projects/91e44ad1ba15473d83fc2255185bfdce => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:50.440486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ede87-9e2b-41db-8182-90fdd1e1f417 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:50.542583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:50.546543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ede87-9e2b-41db-8182-90fdd1e1f417 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:50.583419 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1f8a6-52f8-438a-94bc-6fdbc83b709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:50.584072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1f8a6-52f8-438a-94bc-6fdbc83b709a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:50.584356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1f8a6-52f8-438a-94bc-6fdbc83b709a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:50.584624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1f8a6-52f8-438a-94bc-6fdbc83b709a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:50.585354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1f8a6-52f8-438a-94bc-6fdbc83b709a None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=91e44ad1ba15473d83fc2255185bfdce, user.id=bcbbdc2b78b9406ba6ced602a79570eb) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:50.585662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1f8a6-52f8-438a-94bc-6fdbc83b709a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:50.587100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1f8a6-52f8-438a-94bc-6fdbc83b709a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:50.593952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 570/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:00:50 2022] GET /identity/v3/role_assignments?user.id=bcbbdc2b78b9406ba6ced602a79570eb&scope.project.id=91e44ad1ba15473d83fc2255185bfdce&role.id=55aed406476a485f99f9815f9f27cb3b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:52.589394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff4722-9fd9-4d5d-8448-e125eb5a6c21 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:52.589934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff4722-9fd9-4d5d-8448-e125eb5a6c21 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:52.589934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff4722-9fd9-4d5d-8448-e125eb5a6c21 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:52.591674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 592/1162] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:52.597136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c33ffc-9105-4eb5-bd66-189526958951 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:52.597594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c33ffc-9105-4eb5-bd66-189526958951 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:52.597695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c33ffc-9105-4eb5-bd66-189526958951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:52.616375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-27c33ffc-9105-4eb5-bd66-189526958951 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:52.617577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-27c33ffc-9105-4eb5-bd66-189526958951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:52.688206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 571/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:52.956999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff4722-9fd9-4d5d-8448-e125eb5a6c21 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:52.983293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:53.069567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff4722-9fd9-4d5d-8448-e125eb5a6c21 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:53.105398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5484c-ca4e-40da-9f4b-3c4559aa7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:53.106049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5484c-ca4e-40da-9f4b-3c4559aa7d5d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:53.106326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5484c-ca4e-40da-9f4b-3c4559aa7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:53.106753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5484c-ca4e-40da-9f4b-3c4559aa7d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:53.174577 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5484c-ca4e-40da-9f4b-3c4559aa7d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:53.176042 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5484c-ca4e-40da-9f4b-3c4559aa7d5d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:53.201203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:53.283853 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 593/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:00:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:00:53.289733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c33ffc-9105-4eb5-bd66-189526958951 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:53.383687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:53.393191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c33ffc-9105-4eb5-bd66-189526958951 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:53.456997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39038a0b-d1dc-4250-a665-0c1bab49c60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:53.457667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038a0b-d1dc-4250-a665-0c1bab49c60d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:53.457949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038a0b-d1dc-4250-a665-0c1bab49c60d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:53.458222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39038a0b-d1dc-4250-a665-0c1bab49c60d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:53.465136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39038a0b-d1dc-4250-a665-0c1bab49c60d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:53.466606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39038a0b-d1dc-4250-a665-0c1bab49c60d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-39038a0b-d1dc-4250-a665-0c1bab49c60d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:00:53.477934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:00:53.479225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:00:53.480325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 572/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 11:00:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:00:53.485841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5484c-ca4e-40da-9f4b-3c4559aa7d5d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:53.584964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5484c-ca4e-40da-9f4b-3c4559aa7d5d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:53.609357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:53.619856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21496bd9-85f7-4e2f-8cdd-7f34135a3f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:53.620465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496bd9-85f7-4e2f-8cdd-7f34135a3f9d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:53.620738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496bd9-85f7-4e2f-8cdd-7f34135a3f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:53.621005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496bd9-85f7-4e2f-8cdd-7f34135a3f9d None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:53.622546 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21496bd9-85f7-4e2f-8cdd-7f34135a3f9d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:53.622546 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21496bd9-85f7-4e2f-8cdd-7f34135a3f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:53.623932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21496bd9-85f7-4e2f-8cdd-7f34135a3f9d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:53.631368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 594/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Aug 31 11:00:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:55.562302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da49c6-f064-4d37-990e-cebb4bba9b44 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:55.562838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da49c6-f064-4d37-990e-cebb4bba9b44 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:55.562838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da49c6-f064-4d37-990e-cebb4bba9b44 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:55.564214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 573/1167] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:55.569555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5273d-a4ca-4d79-8288-f312a8170de3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:55.570041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5273d-a4ca-4d79-8288-f312a8170de3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:55.570145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5273d-a4ca-4d79-8288-f312a8170de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:55.588395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bbb5273d-a4ca-4d79-8288-f312a8170de3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:55.589596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bbb5273d-a4ca-4d79-8288-f312a8170de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:55.660330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 595/1168] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:00:55.933960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da49c6-f064-4d37-990e-cebb4bba9b44 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:56.040090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da49c6-f064-4d37-990e-cebb4bba9b44 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:56.075758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07554664-3e59-44af-97d5-2acddbbf5243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:56.076379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07554664-3e59-44af-97d5-2acddbbf5243 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:56.076658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07554664-3e59-44af-97d5-2acddbbf5243 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:56.076930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07554664-3e59-44af-97d5-2acddbbf5243 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:56.077596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07554664-3e59-44af-97d5-2acddbbf5243 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:56.078968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07554664-3e59-44af-97d5-2acddbbf5243 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:56.141422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 574/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Wed Aug 31 11:00:55 2022] POST /identity/v3/domains => generated 267 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:58.141198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d325b-d63b-4d6e-933d-f0b6533ff15f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:58.141760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d325b-d63b-4d6e-933d-f0b6533ff15f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:58.141867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d325b-d63b-4d6e-933d-f0b6533ff15f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:58.143849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 596/1170] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:00:58.151267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a174231-cac6-46e8-b2b4-fe5bdc6db634 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:58.151840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a174231-cac6-46e8-b2b4-fe5bdc6db634 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:58.152303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a174231-cac6-46e8-b2b4-fe5bdc6db634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:58.175561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9a174231-cac6-46e8-b2b4-fe5bdc6db634 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:58.176807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9a174231-cac6-46e8-b2b4-fe5bdc6db634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:58.185109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:58.247311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 575/1171] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:00:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:00:58.528945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d325b-d63b-4d6e-933d-f0b6533ff15f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:58.641030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d325b-d63b-4d6e-933d-f0b6533ff15f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:58.658929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:58.679248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba583c1-293b-4718-8155-2256aff8166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:58.679904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba583c1-293b-4718-8155-2256aff8166c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:58.680446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba583c1-293b-4718-8155-2256aff8166c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:58.680713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba583c1-293b-4718-8155-2256aff8166c None admin] PATH_INFO: `/v3/domains/55c0cead656e4857b567b4c45c5d00a4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:58.692085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba583c1-293b-4718-8155-2256aff8166c None admin] RBAC: Authorizing `identity:get_domain(domain_id=55c0cead656e4857b567b4c45c5d00a4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:58.707600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba583c1-293b-4718-8155-2256aff8166c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:58.707600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 597/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Aug 31 11:00:58 2022] GET /identity/v3/domains/55c0cead656e4857b567b4c45c5d00a4 => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:58.707865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a174231-cac6-46e8-b2b4-fe5bdc6db634 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:58.808034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a174231-cac6-46e8-b2b4-fe5bdc6db634 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:58.846590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ecef-85ef-4138-800a-790b4f693f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:58.847203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ecef-85ef-4138-800a-790b4f693f15 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:58.847480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ecef-85ef-4138-800a-790b4f693f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:58.847769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ecef-85ef-4138-800a-790b4f693f15 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:58.848440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ecef-85ef-4138-800a-790b4f693f15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:58.849867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ecef-85ef-4138-800a-790b4f693f15 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:58.865652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:58.936063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 576/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 11:00:58 2022] POST /identity/v3/projects => generated 361 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:01:00.929988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774c78d-bd37-4d94-9cba-4d2cb376423e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:00.930777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774c78d-bd37-4d94-9cba-4d2cb376423e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:00.930777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774c78d-bd37-4d94-9cba-4d2cb376423e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:00.932168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 598/1174] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:01:00.937770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d732825-5655-4cd9-b702-b47b8cd92655 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:00.938265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d732825-5655-4cd9-b702-b47b8cd92655 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:00.938350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d732825-5655-4cd9-b702-b47b8cd92655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:00.957903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7d732825-5655-4cd9-b702-b47b8cd92655 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:00.959119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7d732825-5655-4cd9-b702-b47b8cd92655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:01.031724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 577/1175] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:01:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:01:01.300510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774c78d-bd37-4d94-9cba-4d2cb376423e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:01.410438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774c78d-bd37-4d94-9cba-4d2cb376423e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:01.445891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e596f-2924-40df-bfa9-7fb2440e7657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:01.446529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e596f-2924-40df-bfa9-7fb2440e7657 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:01.446806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e596f-2924-40df-bfa9-7fb2440e7657 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:01.447079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e596f-2924-40df-bfa9-7fb2440e7657 None admin] PATH_INFO: `/v3/domains/55c0cead656e4857b567b4c45c5d00a4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:01.448236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e596f-2924-40df-bfa9-7fb2440e7657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=55c0cead656e4857b567b4c45c5d00a4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:01.450233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e596f-2924-40df-bfa9-7fb2440e7657 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:01.451946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 599/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Aug 31 11:01:01 2022] GET /identity/v3/domains/55c0cead656e4857b567b4c45c5d00a4 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:01.458164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d732825-5655-4cd9-b702-b47b8cd92655 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:01.564797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d732825-5655-4cd9-b702-b47b8cd92655 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:01.589212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:01.599938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845c2ca-33ed-4c19-9e65-68c8adee0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:01.600547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845c2ca-33ed-4c19-9e65-68c8adee0ed4 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:01.600825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845c2ca-33ed-4c19-9e65-68c8adee0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:01.601097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845c2ca-33ed-4c19-9e65-68c8adee0ed4 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:01.601762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845c2ca-33ed-4c19-9e65-68c8adee0ed4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:01.603195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845c2ca-33ed-4c19-9e65-68c8adee0ed4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:01.705882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 578/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 11:01:01 2022] POST /identity/v3/users => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:03.725912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc761c3-fef4-4434-b36d-486f4e7982ec None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:03.726511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc761c3-fef4-4434-b36d-486f4e7982ec None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:03.726511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc761c3-fef4-4434-b36d-486f4e7982ec None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:03.727790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 600/1178] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:01:03.733408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2a27-5805-4922-b152-80c9596b720d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:03.733925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2a27-5805-4922-b152-80c9596b720d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:03.733925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2a27-5805-4922-b152-80c9596b720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:03.753158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-40af2a27-5805-4922-b152-80c9596b720d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:03.754357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-40af2a27-5805-4922-b152-80c9596b720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:03.825231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 579/1179] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:01:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:01:04.115697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc761c3-fef4-4434-b36d-486f4e7982ec None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.164769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:04.227201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc761c3-fef4-4434-b36d-486f4e7982ec None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.265285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde5b05-e509-4a66-91ce-333f6fde5eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.265926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5b05-e509-4a66-91ce-333f6fde5eff None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.266199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5b05-e509-4a66-91ce-333f6fde5eff None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.266467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5b05-e509-4a66-91ce-333f6fde5eff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.277574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde5b05-e509-4a66-91ce-333f6fde5eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ecde5b05-e509-4a66-91ce-333f6fde5eff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:01:04.282488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:01:04.283690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:01:04.284850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 601/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:01:04.289720 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2a27-5805-4922-b152-80c9596b720d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.398056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2a27-5805-4922-b152-80c9596b720d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.409557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:04.432803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561251-7898-4a9a-ba8b-2b8e258301f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.433402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561251-7898-4a9a-ba8b-2b8e258301f8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.433677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561251-7898-4a9a-ba8b-2b8e258301f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.434071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f561251-7898-4a9a-ba8b-2b8e258301f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.434899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f561251-7898-4a9a-ba8b-2b8e258301f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:04.435197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f561251-7898-4a9a-ba8b-2b8e258301f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:04.436593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f561251-7898-4a9a-ba8b-2b8e258301f8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:04.444577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 580/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:01:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:04.450598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde5b05-e509-4a66-91ce-333f6fde5eff None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.555721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde5b05-e509-4a66-91ce-333f6fde5eff None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.563603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:04.591880 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c65b9-0726-4206-a017-3aa099a21b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.592507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c65b9-0726-4206-a017-3aa099a21b79 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.592776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c65b9-0726-4206-a017-3aa099a21b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.593044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c65b9-0726-4206-a017-3aa099a21b79 None admin] PATH_INFO: `/v3/users/2f0ccbfed9964c3c9643b13559392754` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.606939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c65b9-0726-4206-a017-3aa099a21b79 None admin] RBAC: Authorizing `identity:get_user(user_id=2f0ccbfed9964c3c9643b13559392754)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:04.608402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c65b9-0726-4206-a017-3aa099a21b79 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:04.610011 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 602/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:01:04 2022] GET /identity/v3/users/2f0ccbfed9964c3c9643b13559392754 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:04.616711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561251-7898-4a9a-ba8b-2b8e258301f8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.724491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f561251-7898-4a9a-ba8b-2b8e258301f8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.762536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f2c74-05c3-4af5-ba02-aa8f13e1439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.763300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f2c74-05c3-4af5-ba02-aa8f13e1439f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.763451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f2c74-05c3-4af5-ba02-aa8f13e1439f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.763652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f2c74-05c3-4af5-ba02-aa8f13e1439f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.806193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:04.833334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f2c74-05c3-4af5-ba02-aa8f13e1439f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:04.834792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f2c74-05c3-4af5-ba02-aa8f13e1439f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:04.937700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 581/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:01:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:01:04.944034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c65b9-0726-4206-a017-3aa099a21b79 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:05.046564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c65b9-0726-4206-a017-3aa099a21b79 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:05.082205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33ccf7-2d79-4537-8634-898e09590fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:05.082835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ccf7-2d79-4537-8634-898e09590fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:05.083109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ccf7-2d79-4537-8634-898e09590fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:05.083377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ccf7-2d79-4537-8634-898e09590fe7 None admin] PATH_INFO: `/v3/projects/c527149b62b744a2a6fd9c09d58292ef` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:05.084520 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33ccf7-2d79-4537-8634-898e09590fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=c527149b62b744a2a6fd9c09d58292ef)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:05.085947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33ccf7-2d79-4537-8634-898e09590fe7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:05.087594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 603/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:01:04 2022] GET /identity/v3/projects/c527149b62b744a2a6fd9c09d58292ef => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:05.094865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f2c74-05c3-4af5-ba02-aa8f13e1439f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:05.165980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:05.196542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f2c74-05c3-4af5-ba02-aa8f13e1439f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:05.239321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536244a-f19f-4d78-a069-0a9970e75726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:05.239965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536244a-f19f-4d78-a069-0a9970e75726 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:05.240239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536244a-f19f-4d78-a069-0a9970e75726 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:05.240501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536244a-f19f-4d78-a069-0a9970e75726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:05.241230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536244a-f19f-4d78-a069-0a9970e75726 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=c527149b62b744a2a6fd9c09d58292ef, user.id=2f0ccbfed9964c3c9643b13559392754) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:05.241535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536244a-f19f-4d78-a069-0a9970e75726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:05.242973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536244a-f19f-4d78-a069-0a9970e75726 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:05.249874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 582/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:01:05 2022] GET /identity/v3/role_assignments?user.id=2f0ccbfed9964c3c9643b13559392754&scope.project.id=c527149b62b744a2a6fd9c09d58292ef&role.id=55aed406476a485f99f9815f9f27cb3b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:07.182018 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e77fc-73dc-4e94-bb24-e79caee833e5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:07.182578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e77fc-73dc-4e94-bb24-e79caee833e5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:07.182578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e77fc-73dc-4e94-bb24-e79caee833e5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:07.184143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 604/1186] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:01:07.189294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af77ba5-9d51-4e4d-a8bf-add242d28dd3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:07.189728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af77ba5-9d51-4e4d-a8bf-add242d28dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:07.189829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af77ba5-9d51-4e4d-a8bf-add242d28dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:07.208460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0af77ba5-9d51-4e4d-a8bf-add242d28dd3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:07.209640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0af77ba5-9d51-4e4d-a8bf-add242d28dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:07.298095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 583/1187] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:01:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:01:07.563327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e77fc-73dc-4e94-bb24-e79caee833e5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:07.594728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:07.673522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e77fc-73dc-4e94-bb24-e79caee833e5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:07.706992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1d96-d2f5-4f78-b77e-e8855b3091a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:07.707641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1d96-d2f5-4f78-b77e-e8855b3091a5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:07.707935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1d96-d2f5-4f78-b77e-e8855b3091a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:07.708202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1d96-d2f5-4f78-b77e-e8855b3091a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:07.718408 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be1d96-d2f5-4f78-b77e-e8855b3091a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-55be1d96-d2f5-4f78-b77e-e8855b3091a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:01:07.723049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:01:07.724166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:01:07.725290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 605/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:01:07.730227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af77ba5-9d51-4e4d-a8bf-add242d28dd3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:07.793509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:07.827257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af77ba5-9d51-4e4d-a8bf-add242d28dd3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:07.860285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffb251-5d1a-471d-8c65-b4789f165bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:07.860881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffb251-5d1a-471d-8c65-b4789f165bbe None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:07.861156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffb251-5d1a-471d-8c65-b4789f165bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:07.861425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffb251-5d1a-471d-8c65-b4789f165bbe None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:07.862075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffb251-5d1a-471d-8c65-b4789f165bbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:07.862372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffb251-5d1a-471d-8c65-b4789f165bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:07.863724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffb251-5d1a-471d-8c65-b4789f165bbe None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:07.871679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 584/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:01:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:07.877639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1d96-d2f5-4f78-b77e-e8855b3091a5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:07.973935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:07.982325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1d96-d2f5-4f78-b77e-e8855b3091a5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:08.018111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562054c-cf78-4f3e-9dcb-81c6a5398b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:08.018746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562054c-cf78-4f3e-9dcb-81c6a5398b6d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:08.019027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562054c-cf78-4f3e-9dcb-81c6a5398b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:08.019301 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562054c-cf78-4f3e-9dcb-81c6a5398b6d None admin] PATH_INFO: `/v3/users/2f0ccbfed9964c3c9643b13559392754` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:08.020491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562054c-cf78-4f3e-9dcb-81c6a5398b6d None admin] RBAC: Authorizing `identity:get_user(user_id=2f0ccbfed9964c3c9643b13559392754)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:08.021931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562054c-cf78-4f3e-9dcb-81c6a5398b6d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:08.023528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 606/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:01:07 2022] GET /identity/v3/users/2f0ccbfed9964c3c9643b13559392754 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:08.029920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffb251-5d1a-471d-8c65-b4789f165bbe None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:08.134186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffb251-5d1a-471d-8c65-b4789f165bbe None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:08.160066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:08.167535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d765ee-dd72-4e28-9d97-11b5ff5d5595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:08.172153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d765ee-dd72-4e28-9d97-11b5ff5d5595 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:08.172153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d765ee-dd72-4e28-9d97-11b5ff5d5595 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:08.172153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d765ee-dd72-4e28-9d97-11b5ff5d5595 None admin] PATH_INFO: `/v3/projects/c527149b62b744a2a6fd9c09d58292ef` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:08.172153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d765ee-dd72-4e28-9d97-11b5ff5d5595 None admin] RBAC: Authorizing `identity:get_project(project_id=c527149b62b744a2a6fd9c09d58292ef)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:08.172153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d765ee-dd72-4e28-9d97-11b5ff5d5595 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:08.172919 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 585/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:01:08 2022] GET /identity/v3/projects/c527149b62b744a2a6fd9c09d58292ef => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:08.178942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562054c-cf78-4f3e-9dcb-81c6a5398b6d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:08.277515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562054c-cf78-4f3e-9dcb-81c6a5398b6d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:08.311156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba18a5-ca3d-46b3-9fee-1fe4f6afa300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:08.311830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba18a5-ca3d-46b3-9fee-1fe4f6afa300 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:08.312109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba18a5-ca3d-46b3-9fee-1fe4f6afa300 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:08.312380 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba18a5-ca3d-46b3-9fee-1fe4f6afa300 None admin] PATH_INFO: `/v3/projects/c527149b62b744a2a6fd9c09d58292ef/users/2f0ccbfed9964c3c9643b13559392754/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:08.314259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba18a5-ca3d-46b3-9fee-1fe4f6afa300 None admin] RBAC: Authorizing `identity:create_grant(project_id=c527149b62b744a2a6fd9c09d58292ef, user_id=2f0ccbfed9964c3c9643b13559392754, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:08.315682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba18a5-ca3d-46b3-9fee-1fe4f6afa300 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:08.407025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 607/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 11:01:08 2022] PUT /identity/v3/projects/c527149b62b744a2a6fd9c09d58292ef/users/2f0ccbfed9964c3c9643b13559392754/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:10.482947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e13ff1-a691-4df8-a429-c2af2aa17514 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:10.483511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e13ff1-a691-4df8-a429-c2af2aa17514 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:10.483511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e13ff1-a691-4df8-a429-c2af2aa17514 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:10.485020 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 586/1193] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:01:10.490245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd54c-f313-4b7b-a7a7-1a9097e20911 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:10.490627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd54c-f313-4b7b-a7a7-1a9097e20911 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:10.490791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd54c-f313-4b7b-a7a7-1a9097e20911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:10.509185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9fddd54c-f313-4b7b-a7a7-1a9097e20911 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:10.510352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9fddd54c-f313-4b7b-a7a7-1a9097e20911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:10.524731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:10.578486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 608/1194] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:01:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:01:10.850623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e13ff1-a691-4df8-a429-c2af2aa17514 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:10.950968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e13ff1-a691-4df8-a429-c2af2aa17514 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:10.983711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db5679-6e0d-4c32-b0d9-434287c30a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:10.984349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db5679-6e0d-4c32-b0d9-434287c30a22 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:10.984626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db5679-6e0d-4c32-b0d9-434287c30a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:10.984896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db5679-6e0d-4c32-b0d9-434287c30a22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:10.994611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db5679-6e0d-4c32-b0d9-434287c30a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-11db5679-6e0d-4c32-b0d9-434287c30a22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:01:10.999370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:01:11.000403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:01:11.001313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 587/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:01:11.006535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddd54c-f313-4b7b-a7a7-1a9097e20911 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:11.108406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddd54c-f313-4b7b-a7a7-1a9097e20911 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:11.141810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2190d-6fc3-4c9d-bba5-c3d0e70d35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:11.142417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2190d-6fc3-4c9d-bba5-c3d0e70d35cc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:11.142693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2190d-6fc3-4c9d-bba5-c3d0e70d35cc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:11.142963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2190d-6fc3-4c9d-bba5-c3d0e70d35cc None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:11.143621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2190d-6fc3-4c9d-bba5-c3d0e70d35cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:11.143948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2190d-6fc3-4c9d-bba5-c3d0e70d35cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:11.145315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2190d-6fc3-4c9d-bba5-c3d0e70d35cc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:11.153738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 609/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:11.159866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db5679-6e0d-4c32-b0d9-434287c30a22 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:11.220928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:11.264958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db5679-6e0d-4c32-b0d9-434287c30a22 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:11.302447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee0130-900c-409b-9021-371597b5ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:11.303082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee0130-900c-409b-9021-371597b5ad1e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:11.303365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee0130-900c-409b-9021-371597b5ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:11.303642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee0130-900c-409b-9021-371597b5ad1e None admin] PATH_INFO: `/v3/users/2f0ccbfed9964c3c9643b13559392754` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:11.304795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee0130-900c-409b-9021-371597b5ad1e None admin] RBAC: Authorizing `identity:get_user(user_id=2f0ccbfed9964c3c9643b13559392754)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:11.306484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee0130-900c-409b-9021-371597b5ad1e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:11.308139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 588/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Aug 31 11:01:11 2022] GET /identity/v3/users/2f0ccbfed9964c3c9643b13559392754 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:01:11.314248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2190d-6fc3-4c9d-bba5-c3d0e70d35cc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:11.329274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:11.414423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2190d-6fc3-4c9d-bba5-c3d0e70d35cc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:11.448090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00779f5-b217-4cb8-aa27-bb7e27f9f049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:11.448684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00779f5-b217-4cb8-aa27-bb7e27f9f049 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:11.448959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00779f5-b217-4cb8-aa27-bb7e27f9f049 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:11.449270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00779f5-b217-4cb8-aa27-bb7e27f9f049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:11.522571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00779f5-b217-4cb8-aa27-bb7e27f9f049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:11.524080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00779f5-b217-4cb8-aa27-bb7e27f9f049 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:11.540159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:11.623230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 610/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:01:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:01:11.629170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee0130-900c-409b-9021-371597b5ad1e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:11.727189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee0130-900c-409b-9021-371597b5ad1e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:11.751205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:11.761674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f40e7-4e31-48a9-b5a4-951332b6a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:11.762304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f40e7-4e31-48a9-b5a4-951332b6a628 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:11.762576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f40e7-4e31-48a9-b5a4-951332b6a628 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:11.762846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f40e7-4e31-48a9-b5a4-951332b6a628 None admin] PATH_INFO: `/v3/projects/c527149b62b744a2a6fd9c09d58292ef` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:11.763989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f40e7-4e31-48a9-b5a4-951332b6a628 None admin] RBAC: Authorizing `identity:get_project(project_id=c527149b62b744a2a6fd9c09d58292ef)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:11.765413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f40e7-4e31-48a9-b5a4-951332b6a628 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:11.767090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 589/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Aug 31 11:01:11 2022] GET /identity/v3/projects/c527149b62b744a2a6fd9c09d58292ef => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:11.773398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00779f5-b217-4cb8-aa27-bb7e27f9f049 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:11.885247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00779f5-b217-4cb8-aa27-bb7e27f9f049 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:11.908355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:11.942151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a9d21-600e-4fc1-b162-c432f4ceeadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:11.943131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a9d21-600e-4fc1-b162-c432f4ceeadc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:11.943587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a9d21-600e-4fc1-b162-c432f4ceeadc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:11.944084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a9d21-600e-4fc1-b162-c432f4ceeadc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:11.945343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a9d21-600e-4fc1-b162-c432f4ceeadc None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=c527149b62b744a2a6fd9c09d58292ef, user.id=2f0ccbfed9964c3c9643b13559392754) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:01:11.945819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a9d21-600e-4fc1-b162-c432f4ceeadc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:11.948384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a9d21-600e-4fc1-b162-c432f4ceeadc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:11.958409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 611/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:01:11 2022] GET /identity/v3/role_assignments?user.id=2f0ccbfed9964c3c9643b13559392754&scope.project.id=c527149b62b744a2a6fd9c09d58292ef&role.id=55aed406476a485f99f9815f9f27cb3b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:01:21.784361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:21.954046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=12 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:28.359306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55059b-ae29-490a-8952-569e8f842724 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:28.359918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55059b-ae29-490a-8952-569e8f842724 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:28.359918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55059b-ae29-490a-8952-569e8f842724 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:28.361253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 590/1201] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:02:28.366582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa2f74-b00c-4b38-9e1a-6e1be5bea20c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:28.367021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa2f74-b00c-4b38-9e1a-6e1be5bea20c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:28.367195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa2f74-b00c-4b38-9e1a-6e1be5bea20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:28.387084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6caa2f74-b00c-4b38-9e1a-6e1be5bea20c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:28.388327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6caa2f74-b00c-4b38-9e1a-6e1be5bea20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:28.464778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 612/1202] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:02:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:02:28.741753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55059b-ae29-490a-8952-569e8f842724 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:28.875201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55059b-ae29-490a-8952-569e8f842724 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:28.909211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b770f76-64e8-40bb-9177-e4b494ff8f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:28.909835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b770f76-64e8-40bb-9177-e4b494ff8f7a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:28.910115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b770f76-64e8-40bb-9177-e4b494ff8f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:28.910388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b770f76-64e8-40bb-9177-e4b494ff8f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:28.921380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b770f76-64e8-40bb-9177-e4b494ff8f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:28.922908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b770f76-64e8-40bb-9177-e4b494ff8f7a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-1b770f76-64e8-40bb-9177-e4b494ff8f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:28.938881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:28.940180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:28.941170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:28.941170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:28.941170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:28.941170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 591/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:28.946066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa2f74-b00c-4b38-9e1a-6e1be5bea20c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:29.048739 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa2f74-b00c-4b38-9e1a-6e1be5bea20c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:29.078863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:29.084641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4027a1-73d6-4119-9d06-c35a9a961d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:29.085243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4027a1-73d6-4119-9d06-c35a9a961d04 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:29.087150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4027a1-73d6-4119-9d06-c35a9a961d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:29.087150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4027a1-73d6-4119-9d06-c35a9a961d04 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:29.087150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4027a1-73d6-4119-9d06-c35a9a961d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:29.087150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4027a1-73d6-4119-9d06-c35a9a961d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:29.088671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4027a1-73d6-4119-9d06-c35a9a961d04 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:29.100051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 613/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:29.107833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b770f76-64e8-40bb-9177-e4b494ff8f7a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:29.163263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:29.211351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b770f76-64e8-40bb-9177-e4b494ff8f7a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:29.246918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae3827-cccd-4743-bcb4-db4a6c3b1d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:29.247546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3827-cccd-4743-bcb4-db4a6c3b1d80 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:29.247857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3827-cccd-4743-bcb4-db4a6c3b1d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:29.248131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3827-cccd-4743-bcb4-db4a6c3b1d80 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:29.248812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae3827-cccd-4743-bcb4-db4a6c3b1d80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:29.250290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae3827-cccd-4743-bcb4-db4a6c3b1d80 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:29.429648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 592/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Aug 31 11:02:29 2022] POST /identity/v3/users => generated 251 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:02:31.366630 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32fd9-22ca-4a1c-a67f-d433e76af4be None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:31.367180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32fd9-22ca-4a1c-a67f-d433e76af4be None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:31.367180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32fd9-22ca-4a1c-a67f-d433e76af4be None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:31.368557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 614/1206] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:02:31.374655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f6544-de6b-4a2b-bbad-d861abd31527 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:31.375064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f6544-de6b-4a2b-bbad-d861abd31527 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:31.375212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f6544-de6b-4a2b-bbad-d861abd31527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:31.394588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7f5f6544-de6b-4a2b-bbad-d861abd31527 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:31.395810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7f5f6544-de6b-4a2b-bbad-d861abd31527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:31.463918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 593/1207] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:02:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:02:31.743794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32fd9-22ca-4a1c-a67f-d433e76af4be None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:31.849852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32fd9-22ca-4a1c-a67f-d433e76af4be None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:31.884231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd057-0869-46e2-9eec-403cd6b814e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:31.885044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd057-0869-46e2-9eec-403cd6b814e7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:31.885044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd057-0869-46e2-9eec-403cd6b814e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:31.885538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd057-0869-46e2-9eec-403cd6b814e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:31.896684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bd057-0869-46e2-9eec-403cd6b814e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b68bd057-0869-46e2-9eec-403cd6b814e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:02:31.901609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:31.903063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:31.903977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 615/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 11:02:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:31.908812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f6544-de6b-4a2b-bbad-d861abd31527 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:31.949427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:32.011657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f6544-de6b-4a2b-bbad-d861abd31527 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.057987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c765c8-e51f-4171-88ee-6aad547d721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.058599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c765c8-e51f-4171-88ee-6aad547d721c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.058934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c765c8-e51f-4171-88ee-6aad547d721c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.059148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c765c8-e51f-4171-88ee-6aad547d721c None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.059841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c765c8-e51f-4171-88ee-6aad547d721c None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:32.060146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c765c8-e51f-4171-88ee-6aad547d721c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.061519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c765c8-e51f-4171-88ee-6aad547d721c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.070015 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 594/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 11:02:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:32.076080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd057-0869-46e2-9eec-403cd6b814e7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.132264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:32.189170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd057-0869-46e2-9eec-403cd6b814e7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.224470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070a65-6152-49cd-8524-2b3c32e328bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.225100 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070a65-6152-49cd-8524-2b3c32e328bc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.225379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070a65-6152-49cd-8524-2b3c32e328bc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.225651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070a65-6152-49cd-8524-2b3c32e328bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.239296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7070a65-6152-49cd-8524-2b3c32e328bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.240803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7070a65-6152-49cd-8524-2b3c32e328bc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f7070a65-6152-49cd-8524-2b3c32e328bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:32.257581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:32.258802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:32.259732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:32.259732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:32.259732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:32.259732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 616/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:02:32.265159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c765c8-e51f-4171-88ee-6aad547d721c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.378291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:32.381332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c765c8-e51f-4171-88ee-6aad547d721c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.416762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bf9f2-9244-48c0-a83f-e99a45846501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.417384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bf9f2-9244-48c0-a83f-e99a45846501 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.417665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bf9f2-9244-48c0-a83f-e99a45846501 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.417938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bf9f2-9244-48c0-a83f-e99a45846501 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.418579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bf9f2-9244-48c0-a83f-e99a45846501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:32.418928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bf9f2-9244-48c0-a83f-e99a45846501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.420320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bf9f2-9244-48c0-a83f-e99a45846501 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.431831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 595/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:32.437781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070a65-6152-49cd-8524-2b3c32e328bc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.538941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070a65-6152-49cd-8524-2b3c32e328bc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.540412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:32.573480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195dc01-29da-4250-b839-03420b6bbcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.574092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195dc01-29da-4250-b839-03420b6bbcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.574370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195dc01-29da-4250-b839-03420b6bbcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.574638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195dc01-29da-4250-b839-03420b6bbcd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.581933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195dc01-29da-4250-b839-03420b6bbcd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.583357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195dc01-29da-4250-b839-03420b6bbcd0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0195dc01-29da-4250-b839-03420b6bbcd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:02:32.595425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:32.596598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:32.598039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 617/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:32.602534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bf9f2-9244-48c0-a83f-e99a45846501 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.708305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bf9f2-9244-48c0-a83f-e99a45846501 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.742597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57a5db-37a0-4b19-8dcf-89540e51076d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.743195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57a5db-37a0-4b19-8dcf-89540e51076d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.743469 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57a5db-37a0-4b19-8dcf-89540e51076d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.743735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57a5db-37a0-4b19-8dcf-89540e51076d None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.744815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57a5db-37a0-4b19-8dcf-89540e51076d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:32.745157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57a5db-37a0-4b19-8dcf-89540e51076d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.746681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57a5db-37a0-4b19-8dcf-89540e51076d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:32.765770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 596/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:32.771813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195dc01-29da-4250-b839-03420b6bbcd0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:32.879771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195dc01-29da-4250-b839-03420b6bbcd0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:32.916265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19023983-518d-4632-ac8c-ff9cdf5bf143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:32.916842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19023983-518d-4632-ac8c-ff9cdf5bf143 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:32.917114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19023983-518d-4632-ac8c-ff9cdf5bf143 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:32.917377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19023983-518d-4632-ac8c-ff9cdf5bf143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:32.949657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:32.988458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19023983-518d-4632-ac8c-ff9cdf5bf143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:32.989906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19023983-518d-4632-ac8c-ff9cdf5bf143 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:33.100904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 618/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:02:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:02:33.106801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57a5db-37a0-4b19-8dcf-89540e51076d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:33.125912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:33.206488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57a5db-37a0-4b19-8dcf-89540e51076d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:33.240648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5305a88-a876-47e7-a8f4-d05ee28ef60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:33.241268 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5305a88-a876-47e7-a8f4-d05ee28ef60a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:33.241541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5305a88-a876-47e7-a8f4-d05ee28ef60a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:33.241808 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5305a88-a876-47e7-a8f4-d05ee28ef60a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:33.252615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5305a88-a876-47e7-a8f4-d05ee28ef60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:33.254041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5305a88-a876-47e7-a8f4-d05ee28ef60a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-b5305a88-a876-47e7-a8f4-d05ee28ef60a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:33.269133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:33.270333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:33.271225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:33.271225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:33.271225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:33.271225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 597/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:02:33.276270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19023983-518d-4632-ac8c-ff9cdf5bf143 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:33.340559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:33.378803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19023983-518d-4632-ac8c-ff9cdf5bf143 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:33.420175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23484150-c81c-4845-9441-0b5159c476cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:33.420830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23484150-c81c-4845-9441-0b5159c476cc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:33.421105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23484150-c81c-4845-9441-0b5159c476cc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:33.421375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23484150-c81c-4845-9441-0b5159c476cc None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:33.422003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23484150-c81c-4845-9441-0b5159c476cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:33.422350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23484150-c81c-4845-9441-0b5159c476cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:33.423709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23484150-c81c-4845-9441-0b5159c476cc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:33.435593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 619/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:33.443537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5305a88-a876-47e7-a8f4-d05ee28ef60a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:33.510462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:33.540172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5305a88-a876-47e7-a8f4-d05ee28ef60a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:33.574142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd33489-b0c6-45cc-9e2f-79063684543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:33.574766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd33489-b0c6-45cc-9e2f-79063684543f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:33.575042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd33489-b0c6-45cc-9e2f-79063684543f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:33.575313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd33489-b0c6-45cc-9e2f-79063684543f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:33.581781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd33489-b0c6-45cc-9e2f-79063684543f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:33.583219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd33489-b0c6-45cc-9e2f-79063684543f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-9bd33489-b0c6-45cc-9e2f-79063684543f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:02:33.594829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:33.595908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:33.597211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:02:33.597211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:02:33.597211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:02:33.597211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:02:33.597211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:02:33.597211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:02:33.597211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:33.597211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:33.597211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 598/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:33.601934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23484150-c81c-4845-9441-0b5159c476cc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:33.701248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23484150-c81c-4845-9441-0b5159c476cc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:33.723999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:33.735970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719a5ba-61bb-4c8a-b9d1-ef9af81dc89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:33.736604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719a5ba-61bb-4c8a-b9d1-ef9af81dc89b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:33.736880 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719a5ba-61bb-4c8a-b9d1-ef9af81dc89b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:33.737153 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719a5ba-61bb-4c8a-b9d1-ef9af81dc89b None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:33.737899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719a5ba-61bb-4c8a-b9d1-ef9af81dc89b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:33.738206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719a5ba-61bb-4c8a-b9d1-ef9af81dc89b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:33.739696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719a5ba-61bb-4c8a-b9d1-ef9af81dc89b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:33.752546 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 620/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 11:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:33.758787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd33489-b0c6-45cc-9e2f-79063684543f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:33.860973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd33489-b0c6-45cc-9e2f-79063684543f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:33.889102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:33.894784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8766eda-97e9-40fc-9142-d50d66370fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:33.895446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8766eda-97e9-40fc-9142-d50d66370fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:33.895733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8766eda-97e9-40fc-9142-d50d66370fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:33.896038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8766eda-97e9-40fc-9142-d50d66370fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:33.896760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8766eda-97e9-40fc-9142-d50d66370fc9 None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=cacc0855973047b6a97e40b5f32a8cbb) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:33.897068 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8766eda-97e9-40fc-9142-d50d66370fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:33.898499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8766eda-97e9-40fc-9142-d50d66370fc9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:33.904645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 599/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:02:33 2022] GET /identity/v3/role_assignments?user.id=cacc0855973047b6a97e40b5f32a8cbb&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:35.909381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d479371-5ea3-43fa-a688-c64f14bcd2af None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:35.910027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d479371-5ea3-43fa-a688-c64f14bcd2af None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:35.910027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d479371-5ea3-43fa-a688-c64f14bcd2af None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:35.911251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 621/1220] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:02:35.917077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b673e8-8d44-44b2-968d-744ae1e18e50 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:35.917540 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b673e8-8d44-44b2-968d-744ae1e18e50 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:35.917643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b673e8-8d44-44b2-968d-744ae1e18e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:35.936558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f8b673e8-8d44-44b2-968d-744ae1e18e50 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:35.937853 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f8b673e8-8d44-44b2-968d-744ae1e18e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:36.015412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 600/1221] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:02:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:02:36.286849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d479371-5ea3-43fa-a688-c64f14bcd2af None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:36.392453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d479371-5ea3-43fa-a688-c64f14bcd2af None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:36.434465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001caff-a390-4701-b590-21989126af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:36.435064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001caff-a390-4701-b590-21989126af39 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:36.435341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001caff-a390-4701-b590-21989126af39 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:36.435613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001caff-a390-4701-b590-21989126af39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:36.446364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001caff-a390-4701-b590-21989126af39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1001caff-a390-4701-b590-21989126af39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:02:36.451683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:36.457708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:36.459957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 622/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 11:02:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 11:02:36.461695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b673e8-8d44-44b2-968d-744ae1e18e50 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:36.571289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b673e8-8d44-44b2-968d-744ae1e18e50 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:36.594570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:36.605639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f764ce-73f7-49be-bbef-60f6ac47d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:36.606244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f764ce-73f7-49be-bbef-60f6ac47d20f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:36.606520 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f764ce-73f7-49be-bbef-60f6ac47d20f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:36.606789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f764ce-73f7-49be-bbef-60f6ac47d20f None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:36.607453 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f764ce-73f7-49be-bbef-60f6ac47d20f None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:36.607769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f764ce-73f7-49be-bbef-60f6ac47d20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:36.609185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f764ce-73f7-49be-bbef-60f6ac47d20f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:36.617037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 601/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 11:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:36.623312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001caff-a390-4701-b590-21989126af39 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:36.669762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:36.725501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001caff-a390-4701-b590-21989126af39 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:36.760285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236ace0-e9f1-44d0-af85-1871ee9efda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:36.761541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236ace0-e9f1-44d0-af85-1871ee9efda1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:36.761838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236ace0-e9f1-44d0-af85-1871ee9efda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:36.762105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236ace0-e9f1-44d0-af85-1871ee9efda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:36.772113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236ace0-e9f1-44d0-af85-1871ee9efda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:36.773565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236ace0-e9f1-44d0-af85-1871ee9efda1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8236ace0-e9f1-44d0-af85-1871ee9efda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:36.788855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:36.790188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:36.791980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:36.791980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:36.791980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:36.791980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 623/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:36.796543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f764ce-73f7-49be-bbef-60f6ac47d20f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:36.908971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f764ce-73f7-49be-bbef-60f6ac47d20f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:36.943727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4bf15-0a45-4ce7-b39a-96f00da91db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:36.944403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4bf15-0a45-4ce7-b39a-96f00da91db5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:36.944621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4bf15-0a45-4ce7-b39a-96f00da91db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:36.944891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4bf15-0a45-4ce7-b39a-96f00da91db5 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:36.945558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4bf15-0a45-4ce7-b39a-96f00da91db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:36.945869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4bf15-0a45-4ce7-b39a-96f00da91db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:36.947794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4bf15-0a45-4ce7-b39a-96f00da91db5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:36.959992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 602/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:36.966493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236ace0-e9f1-44d0-af85-1871ee9efda1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.059402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:37.065673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236ace0-e9f1-44d0-af85-1871ee9efda1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.099718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f32d82-d916-4e84-bf45-a06f14b2e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.100379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f32d82-d916-4e84-bf45-a06f14b2e706 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.100658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f32d82-d916-4e84-bf45-a06f14b2e706 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.100942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f32d82-d916-4e84-bf45-a06f14b2e706 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.108564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f32d82-d916-4e84-bf45-a06f14b2e706 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.113851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f32d82-d916-4e84-bf45-a06f14b2e706 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-84f32d82-d916-4e84-bf45-a06f14b2e706 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:02:37.121224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:37.122384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:37.123552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 624/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:37.128323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4bf15-0a45-4ce7-b39a-96f00da91db5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.180163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:37.233182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4bf15-0a45-4ce7-b39a-96f00da91db5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.267248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6285a-b97f-49a0-9939-081cf7db2fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.267881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6285a-b97f-49a0-9939-081cf7db2fff None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.268159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6285a-b97f-49a0-9939-081cf7db2fff None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.268427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6285a-b97f-49a0-9939-081cf7db2fff None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.269146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6285a-b97f-49a0-9939-081cf7db2fff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:37.269445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6285a-b97f-49a0-9939-081cf7db2fff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.270886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6285a-b97f-49a0-9939-081cf7db2fff None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.288961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 603/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Aug 31 11:02:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:37.294604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f32d82-d916-4e84-bf45-a06f14b2e706 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.398963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f32d82-d916-4e84-bf45-a06f14b2e706 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.432525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755a4ce-2b78-4f84-b1a6-7f6a183fc150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.433096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755a4ce-2b78-4f84-b1a6-7f6a183fc150 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.433372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755a4ce-2b78-4f84-b1a6-7f6a183fc150 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.433639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755a4ce-2b78-4f84-b1a6-7f6a183fc150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.443945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755a4ce-2b78-4f84-b1a6-7f6a183fc150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.445406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755a4ce-2b78-4f84-b1a6-7f6a183fc150 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f755a4ce-2b78-4f84-b1a6-7f6a183fc150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:37.461231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:37.463192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:37.464497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:37.464497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:37.464497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:37.464497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 625/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:37.468753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6285a-b97f-49a0-9939-081cf7db2fff None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.571708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6285a-b97f-49a0-9939-081cf7db2fff None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.574430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:37.606777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398c60a-5768-4673-a626-b7664a4cd67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.607376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c60a-5768-4673-a626-b7664a4cd67b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.607652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c60a-5768-4673-a626-b7664a4cd67b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.607948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c60a-5768-4673-a626-b7664a4cd67b None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.608582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398c60a-5768-4673-a626-b7664a4cd67b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:37.608878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398c60a-5768-4673-a626-b7664a4cd67b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.610232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398c60a-5768-4673-a626-b7664a4cd67b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.621347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 604/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:37.627222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755a4ce-2b78-4f84-b1a6-7f6a183fc150 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.637171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:37.727434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755a4ce-2b78-4f84-b1a6-7f6a183fc150 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.760376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ee6a6-8176-404b-8a00-0d05b7649e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.760997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ee6a6-8176-404b-8a00-0d05b7649e27 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.761274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ee6a6-8176-404b-8a00-0d05b7649e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.761548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ee6a6-8176-404b-8a00-0d05b7649e27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.768096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ee6a6-8176-404b-8a00-0d05b7649e27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.769533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ee6a6-8176-404b-8a00-0d05b7649e27 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e50ee6a6-8176-404b-8a00-0d05b7649e27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:02:37.781462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:37.782526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:37.783631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:02:37.783631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:02:37.783631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:02:37.783631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:02:37.783631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:02:37.783631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:02:37.783631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:37.783631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:37.783631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 626/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:37.788469 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398c60a-5768-4673-a626-b7664a4cd67b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:37.892024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398c60a-5768-4673-a626-b7664a4cd67b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:37.926225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eea0f2-695f-4d8c-b87b-bedb8295a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:37.926835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eea0f2-695f-4d8c-b87b-bedb8295a668 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:37.927103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eea0f2-695f-4d8c-b87b-bedb8295a668 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:37.927370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eea0f2-695f-4d8c-b87b-bedb8295a668 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:37.928090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eea0f2-695f-4d8c-b87b-bedb8295a668 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:37.928386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eea0f2-695f-4d8c-b87b-bedb8295a668 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:37.929804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eea0f2-695f-4d8c-b87b-bedb8295a668 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:37.942375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 605/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 11:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:37.949040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ee6a6-8176-404b-8a00-0d05b7649e27 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:38.017554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:38.050994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ee6a6-8176-404b-8a00-0d05b7649e27 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:38.086131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f8978-0b88-4464-95de-3a68740393b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:38.086800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8978-0b88-4464-95de-3a68740393b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:38.087075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8978-0b88-4464-95de-3a68740393b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:38.087344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8978-0b88-4464-95de-3a68740393b7 None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/cacc0855973047b6a97e40b5f32a8cbb/roles/ea287c8c7f9442cf99fb462bb85b39b2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:38.103311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f8978-0b88-4464-95de-3a68740393b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=cacc0855973047b6a97e40b5f32a8cbb, role_id=ea287c8c7f9442cf99fb462bb85b39b2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:38.105330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f8978-0b88-4464-95de-3a68740393b7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:38.199397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 627/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 11:02:37 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/cacc0855973047b6a97e40b5f32a8cbb/roles/ea287c8c7f9442cf99fb462bb85b39b2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:40.094141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d08a45-c783-40f3-acbe-d2d891a617c7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:40.094698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d08a45-c783-40f3-acbe-d2d891a617c7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:40.094698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d08a45-c783-40f3-acbe-d2d891a617c7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:40.096150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 606/1233] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:02:40.101617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51effcc8-f1ea-4950-9157-d32483a4fda2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:40.102065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51effcc8-f1ea-4950-9157-d32483a4fda2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:40.102174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51effcc8-f1ea-4950-9157-d32483a4fda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:40.121027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-51effcc8-f1ea-4950-9157-d32483a4fda2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:40.122224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-51effcc8-f1ea-4950-9157-d32483a4fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:40.189636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 628/1234] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:02:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:02:40.471602 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d08a45-c783-40f3-acbe-d2d891a617c7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:40.486149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:40.562840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d08a45-c783-40f3-acbe-d2d891a617c7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:40.608615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0026b8-2193-4bda-b356-f83012ae4f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:40.609244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0026b8-2193-4bda-b356-f83012ae4f7f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:40.609517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0026b8-2193-4bda-b356-f83012ae4f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:40.609785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0026b8-2193-4bda-b356-f83012ae4f7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:40.620147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0026b8-2193-4bda-b356-f83012ae4f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-cd0026b8-2193-4bda-b356-f83012ae4f7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:02:40.626279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:40.627301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:40.628322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 607/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Aug 31 11:02:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:40.632374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51effcc8-f1ea-4950-9157-d32483a4fda2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:40.684126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:40.739694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51effcc8-f1ea-4950-9157-d32483a4fda2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:40.776444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfe5c8-c849-45e7-a38e-ca8443297505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:40.777021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe5c8-c849-45e7-a38e-ca8443297505 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:40.777270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe5c8-c849-45e7-a38e-ca8443297505 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:40.777575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe5c8-c849-45e7-a38e-ca8443297505 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:40.778858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfe5c8-c849-45e7-a38e-ca8443297505 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:40.778858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfe5c8-c849-45e7-a38e-ca8443297505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:40.779902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfe5c8-c849-45e7-a38e-ca8443297505 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:40.788926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 629/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Aug 31 11:02:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:40.795194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0026b8-2193-4bda-b356-f83012ae4f7f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:40.889291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:40.905926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0026b8-2193-4bda-b356-f83012ae4f7f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:40.944952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173cb60-872f-4083-b86a-2e649f7ec042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:40.945584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173cb60-872f-4083-b86a-2e649f7ec042 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:40.945859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173cb60-872f-4083-b86a-2e649f7ec042 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:40.946127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173cb60-872f-4083-b86a-2e649f7ec042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:40.958674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173cb60-872f-4083-b86a-2e649f7ec042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:40.960150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173cb60-872f-4083-b86a-2e649f7ec042 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-0173cb60-872f-4083-b86a-2e649f7ec042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:40.975810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:40.976950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:40.978729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:40.978729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:40.978729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:40.978729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 608/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:40.983644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfe5c8-c849-45e7-a38e-ca8443297505 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:41.096261 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfe5c8-c849-45e7-a38e-ca8443297505 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:41.106090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:41.130689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3540a-4ae3-4525-acbd-f98eae3e60b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:41.131294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3540a-4ae3-4525-acbd-f98eae3e60b1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:41.131570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3540a-4ae3-4525-acbd-f98eae3e60b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:41.131877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3540a-4ae3-4525-acbd-f98eae3e60b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:41.132515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3540a-4ae3-4525-acbd-f98eae3e60b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:41.132816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3540a-4ae3-4525-acbd-f98eae3e60b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:41.134219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3540a-4ae3-4525-acbd-f98eae3e60b1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:41.145802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 630/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:41.152490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173cb60-872f-4083-b86a-2e649f7ec042 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:41.254701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173cb60-872f-4083-b86a-2e649f7ec042 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:41.289633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4d452-0b1f-4dd7-97de-0670e2e2547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:41.290981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4d452-0b1f-4dd7-97de-0670e2e2547f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:41.291476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4d452-0b1f-4dd7-97de-0670e2e2547f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:41.291788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4d452-0b1f-4dd7-97de-0670e2e2547f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:41.294499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:41.299521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4d452-0b1f-4dd7-97de-0670e2e2547f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:41.301074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4d452-0b1f-4dd7-97de-0670e2e2547f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-81c4d452-0b1f-4dd7-97de-0670e2e2547f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:02:41.312859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:41.314001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:41.315168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 609/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:41.319954 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3540a-4ae3-4525-acbd-f98eae3e60b1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:41.437618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3540a-4ae3-4525-acbd-f98eae3e60b1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:41.471367 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c972-77f6-4265-859d-598d19f90166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:41.471993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c972-77f6-4265-859d-598d19f90166 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:41.472266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c972-77f6-4265-859d-598d19f90166 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:41.472532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c972-77f6-4265-859d-598d19f90166 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:41.473270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c972-77f6-4265-859d-598d19f90166 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:41.473569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c972-77f6-4265-859d-598d19f90166 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:41.474985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c972-77f6-4265-859d-598d19f90166 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:41.492690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 631/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Aug 31 11:02:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:41.498702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4d452-0b1f-4dd7-97de-0670e2e2547f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:41.598239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4d452-0b1f-4dd7-97de-0670e2e2547f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:41.632640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e61b3-838e-4256-a39f-2323de3bca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:41.633237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e61b3-838e-4256-a39f-2323de3bca3c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:41.633510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e61b3-838e-4256-a39f-2323de3bca3c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:41.634348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e61b3-838e-4256-a39f-2323de3bca3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:41.706039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:41.714338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e61b3-838e-4256-a39f-2323de3bca3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:41.715837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e61b3-838e-4256-a39f-2323de3bca3c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:41.817285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 610/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:02:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:02:41.823828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c972-77f6-4265-859d-598d19f90166 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:41.851302 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:41.923183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c972-77f6-4265-859d-598d19f90166 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:41.958018 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5307e-bd91-4c26-8cc5-f82e2368bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:41.958579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5307e-bd91-4c26-8cc5-f82e2368bec8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:41.958855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5307e-bd91-4c26-8cc5-f82e2368bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:41.959125 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5307e-bd91-4c26-8cc5-f82e2368bec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:41.969838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5307e-bd91-4c26-8cc5-f82e2368bec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:41.971291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5307e-bd91-4c26-8cc5-f82e2368bec8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fcb5307e-bd91-4c26-8cc5-f82e2368bec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:41.986987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:41.988693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:41.989798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:41.989798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:41.989798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:41.989798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 632/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:41.994821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e61b3-838e-4256-a39f-2323de3bca3c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:42.123697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:42.130412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e61b3-838e-4256-a39f-2323de3bca3c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:42.164486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b87d4-0385-42b6-97aa-25397db85684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:42.165212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b87d4-0385-42b6-97aa-25397db85684 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:42.165384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b87d4-0385-42b6-97aa-25397db85684 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:42.165652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b87d4-0385-42b6-97aa-25397db85684 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:42.166294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b87d4-0385-42b6-97aa-25397db85684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:42.166591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b87d4-0385-42b6-97aa-25397db85684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:42.168133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b87d4-0385-42b6-97aa-25397db85684 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:42.180349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 611/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:42.187174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5307e-bd91-4c26-8cc5-f82e2368bec8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:42.276889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:42.300128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5307e-bd91-4c26-8cc5-f82e2368bec8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:42.334521 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e08d69-caf9-4702-a20a-d290229e3dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:42.335153 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e08d69-caf9-4702-a20a-d290229e3dad None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:42.335429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e08d69-caf9-4702-a20a-d290229e3dad None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:42.335698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e08d69-caf9-4702-a20a-d290229e3dad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:42.344096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e08d69-caf9-4702-a20a-d290229e3dad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:42.345666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e08d69-caf9-4702-a20a-d290229e3dad None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-59e08d69-caf9-4702-a20a-d290229e3dad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:02:42.357899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:42.371019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:42.372152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:02:42.372152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:02:42.372152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:02:42.372152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:02:42.372152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:02:42.372152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:02:42.372152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:42.372152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:42.372152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 633/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:42.372765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b87d4-0385-42b6-97aa-25397db85684 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:42.475609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b87d4-0385-42b6-97aa-25397db85684 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:42.524550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1691c8a-c99b-4b54-8041-a2eb42aa19ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:42.525252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691c8a-c99b-4b54-8041-a2eb42aa19ea None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:42.525532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691c8a-c99b-4b54-8041-a2eb42aa19ea None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:42.525805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691c8a-c99b-4b54-8041-a2eb42aa19ea None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:42.526512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1691c8a-c99b-4b54-8041-a2eb42aa19ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:42.526820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1691c8a-c99b-4b54-8041-a2eb42aa19ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:42.528348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1691c8a-c99b-4b54-8041-a2eb42aa19ea None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:42.541287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 612/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 11:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:42.547515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e08d69-caf9-4702-a20a-d290229e3dad None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:42.659037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e08d69-caf9-4702-a20a-d290229e3dad None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:42.693297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d71526-2c47-4466-bac9-21d4af65eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:42.693912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71526-2c47-4466-bac9-21d4af65eced None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:42.694192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71526-2c47-4466-bac9-21d4af65eced None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:42.694468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d71526-2c47-4466-bac9-21d4af65eced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:42.695337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d71526-2c47-4466-bac9-21d4af65eced None admin] RBAC: Adding query filter params (role.id=ea287c8c7f9442cf99fb462bb85b39b2, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=cacc0855973047b6a97e40b5f32a8cbb) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:42.695574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d71526-2c47-4466-bac9-21d4af65eced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:42.697507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d71526-2c47-4466-bac9-21d4af65eced None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:42.704239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 634/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:02:42 2022] GET /identity/v3/role_assignments?user.id=cacc0855973047b6a97e40b5f32a8cbb&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=ea287c8c7f9442cf99fb462bb85b39b2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:02:44.725539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10464c5c-e96a-43a8-a3eb-e938ae443da3 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:44.726105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10464c5c-e96a-43a8-a3eb-e938ae443da3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:44.726105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10464c5c-e96a-43a8-a3eb-e938ae443da3 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:44.727991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 613/1247] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:02:44.733923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eab95-3019-4652-8ac6-159f00460ee9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:44.734415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eab95-3019-4652-8ac6-159f00460ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:44.734534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eab95-3019-4652-8ac6-159f00460ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:44.741045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:44.754859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-464eab95-3019-4652-8ac6-159f00460ee9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:44.756103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-464eab95-3019-4652-8ac6-159f00460ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:44.829447 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 635/1248] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:02:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:02:45.101818 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10464c5c-e96a-43a8-a3eb-e938ae443da3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.121068 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:45.206734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10464c5c-e96a-43a8-a3eb-e938ae443da3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.241237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a8ac9-fffe-4618-a88e-e4e394ed516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.241870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a8ac9-fffe-4618-a88e-e4e394ed516a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.242152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a8ac9-fffe-4618-a88e-e4e394ed516a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.242424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a8ac9-fffe-4618-a88e-e4e394ed516a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.253616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a8ac9-fffe-4618-a88e-e4e394ed516a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-ed7a8ac9-fffe-4618-a88e-e4e394ed516a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:02:45.258410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:45.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:45.265166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 614/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:45.266045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464eab95-3019-4652-8ac6-159f00460ee9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.366232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464eab95-3019-4652-8ac6-159f00460ee9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.396106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:45.401172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed70e1-88f6-4fb6-af90-5df3ceaf03bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.401787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed70e1-88f6-4fb6-af90-5df3ceaf03bc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.402056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed70e1-88f6-4fb6-af90-5df3ceaf03bc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.402372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed70e1-88f6-4fb6-af90-5df3ceaf03bc None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.403044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed70e1-88f6-4fb6-af90-5df3ceaf03bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:45.403344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed70e1-88f6-4fb6-af90-5df3ceaf03bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:45.404744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed70e1-88f6-4fb6-af90-5df3ceaf03bc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:45.412794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 636/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:45.419289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a8ac9-fffe-4618-a88e-e4e394ed516a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.498308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:45.520609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a8ac9-fffe-4618-a88e-e4e394ed516a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.554558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a046e-8898-4d9a-8c91-e945595e64b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.555181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a046e-8898-4d9a-8c91-e945595e64b3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.556065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a046e-8898-4d9a-8c91-e945595e64b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.556345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a046e-8898-4d9a-8c91-e945595e64b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.566649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a046e-8898-4d9a-8c91-e945595e64b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:45.568195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a046e-8898-4d9a-8c91-e945595e64b3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-0e8a046e-8898-4d9a-8c91-e945595e64b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:45.582913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:45.583915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:45.584859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:45.584859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:45.584859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:45.584859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 615/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:45.590883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed70e1-88f6-4fb6-af90-5df3ceaf03bc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.695719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed70e1-88f6-4fb6-af90-5df3ceaf03bc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.729636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7bc4-af8f-4ded-b2e9-05b323c1a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.730228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7bc4-af8f-4ded-b2e9-05b323c1a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.730498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7bc4-af8f-4ded-b2e9-05b323c1a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.730780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7bc4-af8f-4ded-b2e9-05b323c1a3f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.731388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf7bc4-af8f-4ded-b2e9-05b323c1a3f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:45.731680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf7bc4-af8f-4ded-b2e9-05b323c1a3f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:45.733237 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf7bc4-af8f-4ded-b2e9-05b323c1a3f5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:45.745098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 637/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:45.751063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a046e-8898-4d9a-8c91-e945595e64b3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.856030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a046e-8898-4d9a-8c91-e945595e64b3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:45.881838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:45.889621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d57c-bf20-40ea-a7d2-df2beadf8846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:45.890243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d57c-bf20-40ea-a7d2-df2beadf8846 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:45.890516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d57c-bf20-40ea-a7d2-df2beadf8846 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:45.890783 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d57c-bf20-40ea-a7d2-df2beadf8846 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:45.898214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46d57c-bf20-40ea-a7d2-df2beadf8846 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:45.901230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46d57c-bf20-40ea-a7d2-df2beadf8846 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-eb46d57c-bf20-40ea-a7d2-df2beadf8846 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:02:45.911158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:45.912441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:45.913704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 616/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:45.918757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7bc4-af8f-4ded-b2e9-05b323c1a3f5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:45.974773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:46.020079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7bc4-af8f-4ded-b2e9-05b323c1a3f5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.057050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3a904-649f-4e63-97a3-7f1a7ec4d9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.057672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3a904-649f-4e63-97a3-7f1a7ec4d9de None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.057951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3a904-649f-4e63-97a3-7f1a7ec4d9de None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.058227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3a904-649f-4e63-97a3-7f1a7ec4d9de None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.059182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3a904-649f-4e63-97a3-7f1a7ec4d9de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:46.059736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3a904-649f-4e63-97a3-7f1a7ec4d9de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.062114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3a904-649f-4e63-97a3-7f1a7ec4d9de None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.090496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 638/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Aug 31 11:02:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:46.096843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d57c-bf20-40ea-a7d2-df2beadf8846 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.200542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d57c-bf20-40ea-a7d2-df2beadf8846 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.233913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e87d0f-1ac0-40df-8f80-21f025a37e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.234452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e87d0f-1ac0-40df-8f80-21f025a37e9b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.234726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e87d0f-1ac0-40df-8f80-21f025a37e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.234995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e87d0f-1ac0-40df-8f80-21f025a37e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.292602 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:46.304699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e87d0f-1ac0-40df-8f80-21f025a37e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.307352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e87d0f-1ac0-40df-8f80-21f025a37e9b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.412301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 617/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:02:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:02:46.418530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3a904-649f-4e63-97a3-7f1a7ec4d9de None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.525412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3a904-649f-4e63-97a3-7f1a7ec4d9de None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.538526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:46.559859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaa722-ee82-4385-a130-c095317f9d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.560503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaa722-ee82-4385-a130-c095317f9d86 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.560760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaa722-ee82-4385-a130-c095317f9d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.561031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaa722-ee82-4385-a130-c095317f9d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.570752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaa722-ee82-4385-a130-c095317f9d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.572806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaa722-ee82-4385-a130-c095317f9d86 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-18aaa722-ee82-4385-a130-c095317f9d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:46.586909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:46.588112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:46.589141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:46.589141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:46.589141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:46.589141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 639/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:46.593992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e87d0f-1ac0-40df-8f80-21f025a37e9b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.692785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:46.705381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e87d0f-1ac0-40df-8f80-21f025a37e9b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.739178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b862d8-049e-47ae-bdab-571b33a79347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.739828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b862d8-049e-47ae-bdab-571b33a79347 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.740156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b862d8-049e-47ae-bdab-571b33a79347 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.743531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b862d8-049e-47ae-bdab-571b33a79347 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.743531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b862d8-049e-47ae-bdab-571b33a79347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:46.743531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b862d8-049e-47ae-bdab-571b33a79347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.743531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b862d8-049e-47ae-bdab-571b33a79347 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.754495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 618/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:46.760305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaa722-ee82-4385-a130-c095317f9d86 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:46.860625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaa722-ee82-4385-a130-c095317f9d86 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:46.894956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a962785-9818-4858-993e-ebd3a74b147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:46.895620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a962785-9818-4858-993e-ebd3a74b147f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:46.895925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a962785-9818-4858-993e-ebd3a74b147f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:46.896196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a962785-9818-4858-993e-ebd3a74b147f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:46.902929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a962785-9818-4858-993e-ebd3a74b147f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:46.904333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a962785-9818-4858-993e-ebd3a74b147f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4a962785-9818-4858-993e-ebd3a74b147f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:02:46.916965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:46.918024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:46.919119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:02:46.919119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:02:46.919119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:02:46.919119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:02:46.919119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:02:46.919119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:02:46.919119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:46.919119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:46.919119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 640/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:46.923943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b862d8-049e-47ae-bdab-571b33a79347 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:47.022826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b862d8-049e-47ae-bdab-571b33a79347 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:47.057111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39961631-994e-4d5d-ab1a-5ba56e5f77ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:47.059330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39961631-994e-4d5d-ab1a-5ba56e5f77ee None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:47.059330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39961631-994e-4d5d-ab1a-5ba56e5f77ee None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:47.059330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39961631-994e-4d5d-ab1a-5ba56e5f77ee None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:47.059330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39961631-994e-4d5d-ab1a-5ba56e5f77ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:47.059330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39961631-994e-4d5d-ab1a-5ba56e5f77ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:47.060708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39961631-994e-4d5d-ab1a-5ba56e5f77ee None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:47.073390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 619/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 11:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:47.079511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a962785-9818-4858-993e-ebd3a74b147f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:47.106239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:47.177671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a962785-9818-4858-993e-ebd3a74b147f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:47.210632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612b84a-1692-47c7-9abf-68d3b7d9d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:47.211232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612b84a-1692-47c7-9abf-68d3b7d9d322 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:47.212065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612b84a-1692-47c7-9abf-68d3b7d9d322 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:47.212335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612b84a-1692-47c7-9abf-68d3b7d9d322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:47.213057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612b84a-1692-47c7-9abf-68d3b7d9d322 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=cacc0855973047b6a97e40b5f32a8cbb) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:47.213353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612b84a-1692-47c7-9abf-68d3b7d9d322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:47.214760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612b84a-1692-47c7-9abf-68d3b7d9d322 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:47.220251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 641/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:02:47 2022] GET /identity/v3/role_assignments?user.id=cacc0855973047b6a97e40b5f32a8cbb&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=55aed406476a485f99f9815f9f27cb3b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:49.185568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee1504-0122-4aef-a72c-849b8525bea2 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:49.186104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee1504-0122-4aef-a72c-849b8525bea2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:49.186104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee1504-0122-4aef-a72c-849b8525bea2 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:49.187495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 620/1261] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:02:49.192722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e356d45-ca84-4103-9b57-b331572315a9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:49.193133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e356d45-ca84-4103-9b57-b331572315a9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:49.193266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e356d45-ca84-4103-9b57-b331572315a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:49.212812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7e356d45-ca84-4103-9b57-b331572315a9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:49.214013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7e356d45-ca84-4103-9b57-b331572315a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:49.284438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 642/1262] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:02:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:02:49.559816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee1504-0122-4aef-a72c-849b8525bea2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:49.571601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:49.662603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee1504-0122-4aef-a72c-849b8525bea2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:49.698529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4b7f6-ffcc-4fa6-9908-8a597c5f5188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:49.699180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4b7f6-ffcc-4fa6-9908-8a597c5f5188 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:49.699458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4b7f6-ffcc-4fa6-9908-8a597c5f5188 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:49.699729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4b7f6-ffcc-4fa6-9908-8a597c5f5188 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:49.709951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4b7f6-ffcc-4fa6-9908-8a597c5f5188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-64e4b7f6-ffcc-4fa6-9908-8a597c5f5188 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:02:49.714797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:49.715937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:49.716894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 621/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:02:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:49.722310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e356d45-ca84-4103-9b57-b331572315a9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:49.741512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:49.823812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e356d45-ca84-4103-9b57-b331572315a9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:49.858604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb923be4-bc7b-47b2-886d-d6aa35513428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:49.859198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923be4-bc7b-47b2-886d-d6aa35513428 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:49.859473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923be4-bc7b-47b2-886d-d6aa35513428 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:49.859779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb923be4-bc7b-47b2-886d-d6aa35513428 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:49.860433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb923be4-bc7b-47b2-886d-d6aa35513428 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:49.860732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb923be4-bc7b-47b2-886d-d6aa35513428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:49.862154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb923be4-bc7b-47b2-886d-d6aa35513428 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:49.870923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 643/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:49.876735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4b7f6-ffcc-4fa6-9908-8a597c5f5188 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:49.943470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:49.974952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4b7f6-ffcc-4fa6-9908-8a597c5f5188 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.008604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6dcaf-866f-433e-a6db-d072dafeece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.009267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6dcaf-866f-433e-a6db-d072dafeece7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.009545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6dcaf-866f-433e-a6db-d072dafeece7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.009816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6dcaf-866f-433e-a6db-d072dafeece7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.019477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6dcaf-866f-433e-a6db-d072dafeece7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.020991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6dcaf-866f-433e-a6db-d072dafeece7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-36f6dcaf-866f-433e-a6db-d072dafeece7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:50.048456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:50.049726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:50.056380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:50.056380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:50.056380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:50.056380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 622/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:50.060132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb923be4-bc7b-47b2-886d-d6aa35513428 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.138445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:50.157086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb923be4-bc7b-47b2-886d-d6aa35513428 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.190746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5f568-1011-4f82-9646-c5059e3bd46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.191360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5f568-1011-4f82-9646-c5059e3bd46e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.191639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5f568-1011-4f82-9646-c5059e3bd46e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.191942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5f568-1011-4f82-9646-c5059e3bd46e None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.192588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5f568-1011-4f82-9646-c5059e3bd46e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:50.192885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5f568-1011-4f82-9646-c5059e3bd46e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.194251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5f568-1011-4f82-9646-c5059e3bd46e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.207564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 644/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:50.213551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6dcaf-866f-433e-a6db-d072dafeece7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.316446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6dcaf-866f-433e-a6db-d072dafeece7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.336667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:50.350800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889ada4-7e8b-4c99-857d-69baf309df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.351429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889ada4-7e8b-4c99-857d-69baf309df67 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.351714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889ada4-7e8b-4c99-857d-69baf309df67 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.352100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889ada4-7e8b-4c99-857d-69baf309df67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.360981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889ada4-7e8b-4c99-857d-69baf309df67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.362470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889ada4-7e8b-4c99-857d-69baf309df67 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3889ada4-7e8b-4c99-857d-69baf309df67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:02:50.374712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:50.378072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:50.379252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 623/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:50.381878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5f568-1011-4f82-9646-c5059e3bd46e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.502899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5f568-1011-4f82-9646-c5059e3bd46e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.545702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551546e-e215-4b5b-9f6a-d1f53f4a0b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.546387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551546e-e215-4b5b-9f6a-d1f53f4a0b96 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.546681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551546e-e215-4b5b-9f6a-d1f53f4a0b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.546952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551546e-e215-4b5b-9f6a-d1f53f4a0b96 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.547691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551546e-e215-4b5b-9f6a-d1f53f4a0b96 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:50.548030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551546e-e215-4b5b-9f6a-d1f53f4a0b96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.549462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551546e-e215-4b5b-9f6a-d1f53f4a0b96 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.559717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:50.569323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 645/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Aug 31 11:02:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:50.575427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889ada4-7e8b-4c99-857d-69baf309df67 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.691563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889ada4-7e8b-4c99-857d-69baf309df67 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.731907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc44242-a4b1-4779-95c9-fe5a98eb0c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.732543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc44242-a4b1-4779-95c9-fe5a98eb0c03 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.732818 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc44242-a4b1-4779-95c9-fe5a98eb0c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.733084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc44242-a4b1-4779-95c9-fe5a98eb0c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.745316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc44242-a4b1-4779-95c9-fe5a98eb0c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.746824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc44242-a4b1-4779-95c9-fe5a98eb0c03 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8bc44242-a4b1-4779-95c9-fe5a98eb0c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:50.761532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:50.762682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:50.763963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:50.763963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:50.763963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:50.763963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 624/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:50.768688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551546e-e215-4b5b-9f6a-d1f53f4a0b96 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.877216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551546e-e215-4b5b-9f6a-d1f53f4a0b96 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:50.917073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee82ef-eb15-47bc-9466-98015fca29d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:50.917806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee82ef-eb15-47bc-9466-98015fca29d6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:50.918164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee82ef-eb15-47bc-9466-98015fca29d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:50.918538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee82ef-eb15-47bc-9466-98015fca29d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:50.919277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee82ef-eb15-47bc-9466-98015fca29d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:50.919660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee82ef-eb15-47bc-9466-98015fca29d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:50.921224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee82ef-eb15-47bc-9466-98015fca29d6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:50.933811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 646/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:50.939476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc44242-a4b1-4779-95c9-fe5a98eb0c03 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:50.971467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:51.039303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc44242-a4b1-4779-95c9-fe5a98eb0c03 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.074023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7676054-d279-44d6-8cf4-eaf7403e096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.074646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7676054-d279-44d6-8cf4-eaf7403e096e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.074924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7676054-d279-44d6-8cf4-eaf7403e096e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.075196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7676054-d279-44d6-8cf4-eaf7403e096e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.081832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7676054-d279-44d6-8cf4-eaf7403e096e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.083266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7676054-d279-44d6-8cf4-eaf7403e096e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a7676054-d279-44d6-8cf4-eaf7403e096e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:02:51.094940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:51.100500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:51.101690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:02:51.101690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:02:51.101690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:02:51.101690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:02:51.101690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:02:51.101690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:02:51.101690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:51.101690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:51.101690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 625/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:51.102906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee82ef-eb15-47bc-9466-98015fca29d6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.165175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:51.207597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee82ef-eb15-47bc-9466-98015fca29d6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.241200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ced061-54e6-4137-8790-872566351e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.241802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ced061-54e6-4137-8790-872566351e4b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.242080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ced061-54e6-4137-8790-872566351e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.242352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ced061-54e6-4137-8790-872566351e4b None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.243378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ced061-54e6-4137-8790-872566351e4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:51.243686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ced061-54e6-4137-8790-872566351e4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.245152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ced061-54e6-4137-8790-872566351e4b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.257982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 647/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 11:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:51.264884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7676054-d279-44d6-8cf4-eaf7403e096e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:51.358934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:51.368165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7676054-d279-44d6-8cf4-eaf7403e096e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:51.403339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4e93d-e038-408e-8bcd-90c2353e766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:51.404032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e93d-e038-408e-8bcd-90c2353e766f None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:51.405771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e93d-e038-408e-8bcd-90c2353e766f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:51.405771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e93d-e038-408e-8bcd-90c2353e766f None admin] PATH_INFO: `/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/cacc0855973047b6a97e40b5f32a8cbb/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:51.406508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4e93d-e038-408e-8bcd-90c2353e766f None admin] RBAC: Authorizing `identity:create_grant(project_id=88e59bcfd667410fbeb00ffdce6a8bca, user_id=cacc0855973047b6a97e40b5f32a8cbb, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:51.407974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4e93d-e038-408e-8bcd-90c2353e766f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:51.615441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 626/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Aug 31 11:02:51 2022] PUT /identity/v3/projects/88e59bcfd667410fbeb00ffdce6a8bca/users/cacc0855973047b6a97e40b5f32a8cbb/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:02:53.557001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21072e74-154e-4d6e-9818-3b37d1e55e20 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:53.557583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21072e74-154e-4d6e-9818-3b37d1e55e20 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:53.557583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21072e74-154e-4d6e-9818-3b37d1e55e20 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:53.558891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 648/1274] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:02:53.564210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a30e81-eb14-462e-aeba-efb070453587 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:53.564628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a30e81-eb14-462e-aeba-efb070453587 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:53.564741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a30e81-eb14-462e-aeba-efb070453587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:53.583103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b2a30e81-eb14-462e-aeba-efb070453587 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:53.584335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b2a30e81-eb14-462e-aeba-efb070453587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:53.650047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 627/1275] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:02:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 11:02:53.922398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21072e74-154e-4d6e-9818-3b37d1e55e20 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:54.029479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21072e74-154e-4d6e-9818-3b37d1e55e20 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:54.046665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:54.067821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96036a61-a83b-46f2-b03e-3a64094f8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:54.068469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96036a61-a83b-46f2-b03e-3a64094f8ccf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:54.068741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96036a61-a83b-46f2-b03e-3a64094f8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:54.069011 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96036a61-a83b-46f2-b03e-3a64094f8ccf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:54.080532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96036a61-a83b-46f2-b03e-3a64094f8ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-96036a61-a83b-46f2-b03e-3a64094f8ccf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 11:02:54.085333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:54.086627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:54.087941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 649/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Aug 31 11:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:54.092803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a30e81-eb14-462e-aeba-efb070453587 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:54.176908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:54.195277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a30e81-eb14-462e-aeba-efb070453587 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:54.231070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8602f-4943-416b-bc68-e604d6128867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:54.231711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8602f-4943-416b-bc68-e604d6128867 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:54.232029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8602f-4943-416b-bc68-e604d6128867 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:54.232302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8602f-4943-416b-bc68-e604d6128867 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:54.232970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8602f-4943-416b-bc68-e604d6128867 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:54.233272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8602f-4943-416b-bc68-e604d6128867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:54.234650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8602f-4943-416b-bc68-e604d6128867 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:54.244473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 628/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Aug 31 11:02:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:54.249993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96036a61-a83b-46f2-b03e-3a64094f8ccf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:54.355014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96036a61-a83b-46f2-b03e-3a64094f8ccf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:54.389711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118a5a3-0466-4449-bbc6-82f0e74fa68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:54.390349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118a5a3-0466-4449-bbc6-82f0e74fa68f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:54.390626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118a5a3-0466-4449-bbc6-82f0e74fa68f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:54.390907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118a5a3-0466-4449-bbc6-82f0e74fa68f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:54.402003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118a5a3-0466-4449-bbc6-82f0e74fa68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:54.403451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118a5a3-0466-4449-bbc6-82f0e74fa68f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9118a5a3-0466-4449-bbc6-82f0e74fa68f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:54.418079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:54.419225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:54.424391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:54.424391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:54.424391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:54.424391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 650/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:54.425177 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8602f-4943-416b-bc68-e604d6128867 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:54.527998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8602f-4943-416b-bc68-e604d6128867 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:54.563691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec1703-3674-4459-bb00-cfe413e1e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:54.564331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec1703-3674-4459-bb00-cfe413e1e8fc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:54.564911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec1703-3674-4459-bb00-cfe413e1e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:54.564911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec1703-3674-4459-bb00-cfe413e1e8fc None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:54.565493 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec1703-3674-4459-bb00-cfe413e1e8fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:54.565792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec1703-3674-4459-bb00-cfe413e1e8fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:54.567161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec1703-3674-4459-bb00-cfe413e1e8fc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:54.579101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 629/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:02:54.585017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118a5a3-0466-4449-bbc6-82f0e74fa68f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:54.618193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:54.687720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118a5a3-0466-4449-bbc6-82f0e74fa68f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:54.721762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cfd46-bb56-4767-81aa-73db18279c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:54.722393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cfd46-bb56-4767-81aa-73db18279c28 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:54.722683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cfd46-bb56-4767-81aa-73db18279c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:54.722923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cfd46-bb56-4767-81aa-73db18279c28 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:54.731354 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cfd46-bb56-4767-81aa-73db18279c28 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:54.732824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cfd46-bb56-4767-81aa-73db18279c28 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-731cfd46-bb56-4767-81aa-73db18279c28 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 11:02:54.752886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:54.754102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 11:02:54.755159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:54.759612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 651/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:54.761313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec1703-3674-4459-bb00-cfe413e1e8fc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:54.766458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:54.873363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec1703-3674-4459-bb00-cfe413e1e8fc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:54.907913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143c283-a2e5-4b56-adce-c5e6b6835fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:54.908518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c283-a2e5-4b56-adce-c5e6b6835fed None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:54.908797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c283-a2e5-4b56-adce-c5e6b6835fed None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:54.909067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c283-a2e5-4b56-adce-c5e6b6835fed None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:54.909791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143c283-a2e5-4b56-adce-c5e6b6835fed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:54.910093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143c283-a2e5-4b56-adce-c5e6b6835fed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:54.911511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143c283-a2e5-4b56-adce-c5e6b6835fed None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:54.929325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 630/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Aug 31 11:02:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:54.935519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cfd46-bb56-4767-81aa-73db18279c28 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:55.030110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:55.040436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cfd46-bb56-4767-81aa-73db18279c28 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:55.076506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ae39b-c3df-417b-809a-6787d79dde14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:55.077117 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ae39b-c3df-417b-809a-6787d79dde14 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:55.077394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ae39b-c3df-417b-809a-6787d79dde14 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:55.077661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ae39b-c3df-417b-809a-6787d79dde14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:55.161399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ae39b-c3df-417b-809a-6787d79dde14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:55.162767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ae39b-c3df-417b-809a-6787d79dde14 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:55.268408 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:55.279414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 652/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Aug 31 11:02:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 11:02:55.285293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143c283-a2e5-4b56-adce-c5e6b6835fed None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:55.359540 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:55.400413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143c283-a2e5-4b56-adce-c5e6b6835fed None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:55.436718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23fddf-c524-48c0-aefc-7fe0fa7da6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:55.437272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23fddf-c524-48c0-aefc-7fe0fa7da6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:55.437548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23fddf-c524-48c0-aefc-7fe0fa7da6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:55.437816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23fddf-c524-48c0-aefc-7fe0fa7da6f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:55.448306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23fddf-c524-48c0-aefc-7fe0fa7da6f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:55.449754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23fddf-c524-48c0-aefc-7fe0fa7da6f8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-ac23fddf-c524-48c0-aefc-7fe0fa7da6f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 11:02:55.464838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:55.470931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 11:02:55.472165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 11:02:55.472165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 11:02:55.472165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:55.472165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 631/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:55.472631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ae39b-c3df-417b-809a-6787d79dde14 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:55.581739 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ae39b-c3df-417b-809a-6787d79dde14 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:55.618917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b161c-44d6-4219-8944-96ed448b146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:55.619590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b161c-44d6-4219-8944-96ed448b146d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:55.619840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b161c-44d6-4219-8944-96ed448b146d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:55.620094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b161c-44d6-4219-8944-96ed448b146d None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:55.620735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b161c-44d6-4219-8944-96ed448b146d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:55.621038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b161c-44d6-4219-8944-96ed448b146d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:55.622400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b161c-44d6-4219-8944-96ed448b146d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:55.634358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 653/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Aug 31 11:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:55.640203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23fddf-c524-48c0-aefc-7fe0fa7da6f8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:55.748057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23fddf-c524-48c0-aefc-7fe0fa7da6f8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:55.762625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:55.783234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143591e-a5d8-48a5-9796-ff07efbdefef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:55.783892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143591e-a5d8-48a5-9796-ff07efbdefef None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:55.784171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143591e-a5d8-48a5-9796-ff07efbdefef None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:55.784436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143591e-a5d8-48a5-9796-ff07efbdefef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:55.791775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143591e-a5d8-48a5-9796-ff07efbdefef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:55.793232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143591e-a5d8-48a5-9796-ff07efbdefef None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d143591e-a5d8-48a5-9796-ff07efbdefef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 11:02:55.805339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:55.806638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:55.807589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 11:02:55.807589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 11:02:55.807589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 11:02:55.807589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 11:02:55.807589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 11:02:55.807589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 11:02:55.807589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 11:02:55.807589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 31 11:02:55.807589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 632/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Aug 31 11:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:55.813403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b161c-44d6-4219-8944-96ed448b146d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:55.878953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:55.934066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b161c-44d6-4219-8944-96ed448b146d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:55.972530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe2577-5675-4269-b5ee-edc12ba0fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:55.973134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2577-5675-4269-b5ee-edc12ba0fe9b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:55.973407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2577-5675-4269-b5ee-edc12ba0fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:55.973673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2577-5675-4269-b5ee-edc12ba0fe9b None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:55.974360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2577-5675-4269-b5ee-edc12ba0fe9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:55.974655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2577-5675-4269-b5ee-edc12ba0fe9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:55.976099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2577-5675-4269-b5ee-edc12ba0fe9b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:55.988723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 654/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Aug 31 11:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:55.995073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143591e-a5d8-48a5-9796-ff07efbdefef None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:56.098212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143591e-a5d8-48a5-9796-ff07efbdefef None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:56.132038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b044a45-7e73-4d1e-ad5a-837c3f513171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:56.132651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b044a45-7e73-4d1e-ad5a-837c3f513171 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:56.133545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b044a45-7e73-4d1e-ad5a-837c3f513171 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:56.150651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b044a45-7e73-4d1e-ad5a-837c3f513171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:56.150651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b044a45-7e73-4d1e-ad5a-837c3f513171 None admin] RBAC: Adding query filter params (role.id=55aed406476a485f99f9815f9f27cb3b, scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca, user.id=cacc0855973047b6a97e40b5f32a8cbb) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:56.150651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b044a45-7e73-4d1e-ad5a-837c3f513171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:56.150651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b044a45-7e73-4d1e-ad5a-837c3f513171 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:56.150651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 633/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Aug 31 11:02:55 2022] GET /identity/v3/role_assignments?user.id=cacc0855973047b6a97e40b5f32a8cbb&scope.project.id=88e59bcfd667410fbeb00ffdce6a8bca&role.id=55aed406476a485f99f9815f9f27cb3b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:02:58.157457 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c28a5-6494-4e57-9a45-669a4a46f339 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:58.158193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c28a5-6494-4e57-9a45-669a4a46f339 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:58.158193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c28a5-6494-4e57-9a45-669a4a46f339 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:58.165598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 655/1288] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:02:58.173512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ddb96-a1e1-444a-ada3-e60429b06bbb None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:58.174069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ddb96-a1e1-444a-ada3-e60429b06bbb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:58.174069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ddb96-a1e1-444a-ada3-e60429b06bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:58.194232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-024ddb96-a1e1-444a-ada3-e60429b06bbb None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:02:58.196005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-024ddb96-a1e1-444a-ada3-e60429b06bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:02:58.229214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:58.272853 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 634/1289] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:02:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:02:58.555881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c28a5-6494-4e57-9a45-669a4a46f339 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:58.692450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c28a5-6494-4e57-9a45-669a4a46f339 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:58.706162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:58.733825 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a44a-8d00-4ce4-a506-845809bb61af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:58.734480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a44a-8d00-4ce4-a506-845809bb61af None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:58.734920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a44a-8d00-4ce4-a506-845809bb61af None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:58.735529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857a44a-8d00-4ce4-a506-845809bb61af None admin] PATH_INFO: `/v3/services/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:58.736449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a44a-8d00-4ce4-a506-845809bb61af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:58.738074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857a44a-8d00-4ce4-a506-845809bb61af None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c857a44a-8d00-4ce4-a506-845809bb61af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:02:58.752796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:02:58.754586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:02:58.755878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:02:58.760650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 656/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 11:02:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:02:58.763051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ddb96-a1e1-444a-ada3-e60429b06bbb None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:58.884262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ddb96-a1e1-444a-ada3-e60429b06bbb None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:58.923137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86acf0-a9ab-4ee7-a665-8f42c55b0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:58.924224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86acf0-a9ab-4ee7-a665-8f42c55b0ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:58.924224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86acf0-a9ab-4ee7-a665-8f42c55b0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:58.924421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86acf0-a9ab-4ee7-a665-8f42c55b0ae8 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:58.924951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86acf0-a9ab-4ee7-a665-8f42c55b0ae8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:58.925260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86acf0-a9ab-4ee7-a665-8f42c55b0ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:58.926627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86acf0-a9ab-4ee7-a665-8f42c55b0ae8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:58.934036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 635/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Aug 31 11:02:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:02:58.940634 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a44a-8d00-4ce4-a506-845809bb61af None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:02:59.050372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857a44a-8d00-4ce4-a506-845809bb61af None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:02:59.084299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbdc2c-1f1d-4572-985d-dea282e4b393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:02:59.084901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbdc2c-1f1d-4572-985d-dea282e4b393 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:02:59.085174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbdc2c-1f1d-4572-985d-dea282e4b393 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:02:59.085443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbdc2c-1f1d-4572-985d-dea282e4b393 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:02:59.086689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbdc2c-1f1d-4572-985d-dea282e4b393 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:02:59.087168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbdc2c-1f1d-4572-985d-dea282e4b393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:02:59.088564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbdc2c-1f1d-4572-985d-dea282e4b393 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:02:59.093046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 657/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Aug 31 11:02:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:03:01.022319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b348a6-fc14-4f24-84a9-6bbaf79d9b66 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:01.022855 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b348a6-fc14-4f24-84a9-6bbaf79d9b66 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:01.022855 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b348a6-fc14-4f24-84a9-6bbaf79d9b66 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:01.024874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 636/1293] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:03:01.030995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f694ff0-14b3-4796-9a2a-9c46db1a32bb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:01.031462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f694ff0-14b3-4796-9a2a-9c46db1a32bb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:01.031986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f694ff0-14b3-4796-9a2a-9c46db1a32bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:01.051041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7f694ff0-14b3-4796-9a2a-9c46db1a32bb None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:01.052291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7f694ff0-14b3-4796-9a2a-9c46db1a32bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:01.082359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:01.118813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 658/1294] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:03:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:03:01.389455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b348a6-fc14-4f24-84a9-6bbaf79d9b66 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:01.420163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:01.490736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b348a6-fc14-4f24-84a9-6bbaf79d9b66 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:01.524721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2d1a7-db8f-49cd-849e-a49f5540238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:01.525323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2d1a7-db8f-49cd-849e-a49f5540238b None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:01.525598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2d1a7-db8f-49cd-849e-a49f5540238b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:01.525867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2d1a7-db8f-49cd-849e-a49f5540238b None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:01.526522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2d1a7-db8f-49cd-849e-a49f5540238b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:01.527914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2d1a7-db8f-49cd-849e-a49f5540238b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:01.626835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 637/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Aug 31 11:03:01 2022] POST /identity/v3/services => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:03.565950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e9f6a-c3c5-41d2-bfc0-37a7aa2b87d4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.566519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e9f6a-c3c5-41d2-bfc0-37a7aa2b87d4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.566795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e9f6a-c3c5-41d2-bfc0-37a7aa2b87d4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.568492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 659/1296] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:03:03.573873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe0ec4-4452-4c11-9d39-545f7640696b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:03.574319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe0ec4-4452-4c11-9d39-545f7640696b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:03.574453 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe0ec4-4452-4c11-9d39-545f7640696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:03.593384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9ffe0ec4-4452-4c11-9d39-545f7640696b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:03.594584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9ffe0ec4-4452-4c11-9d39-545f7640696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:03.676436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 638/1297] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:03:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:03:03.952771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e9f6a-c3c5-41d2-bfc0-37a7aa2b87d4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.066672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e9f6a-c3c5-41d2-bfc0-37a7aa2b87d4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.102291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16d0fb-8e76-4445-be86-9be55f5a04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.102921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d0fb-8e76-4445-be86-9be55f5a04ae None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.103194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d0fb-8e76-4445-be86-9be55f5a04ae None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.103455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d0fb-8e76-4445-be86-9be55f5a04ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.104063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16d0fb-8e76-4445-be86-9be55f5a04ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.105422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16d0fb-8e76-4445-be86-9be55f5a04ae None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6f16d0fb-8e76-4445-be86-9be55f5a04ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:03:04.114462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:03:04.115628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:03:04.117113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 660/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 11:03:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:03:04.121827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe0ec4-4452-4c11-9d39-545f7640696b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.141042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:04.223821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe0ec4-4452-4c11-9d39-545f7640696b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.258311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1363b8-7ee0-4f39-ab70-30e75bc12415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.258925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1363b8-7ee0-4f39-ab70-30e75bc12415 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.259204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1363b8-7ee0-4f39-ab70-30e75bc12415 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.259475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1363b8-7ee0-4f39-ab70-30e75bc12415 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.260152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1363b8-7ee0-4f39-ab70-30e75bc12415 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:03:04.260496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1363b8-7ee0-4f39-ab70-30e75bc12415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.261867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1363b8-7ee0-4f39-ab70-30e75bc12415 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.267154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 639/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Aug 31 11:03:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:03:04.274106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16d0fb-8e76-4445-be86-9be55f5a04ae None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.307851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:04.384098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16d0fb-8e76-4445-be86-9be55f5a04ae None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.420383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3155c3-70bc-4e4f-b2dc-7cb2f8cc3b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.421001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3155c3-70bc-4e4f-b2dc-7cb2f8cc3b85 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.421281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3155c3-70bc-4e4f-b2dc-7cb2f8cc3b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.421554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3155c3-70bc-4e4f-b2dc-7cb2f8cc3b85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.422266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3155c3-70bc-4e4f-b2dc-7cb2f8cc3b85 None admin] RBAC: Adding query filter params (interface=public, service_id=708700f118d445dda97cc031675a1e2c, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:03:04.422573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3155c3-70bc-4e4f-b2dc-7cb2f8cc3b85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.423986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3155c3-70bc-4e4f-b2dc-7cb2f8cc3b85 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.430715 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 661/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Aug 31 11:03:04 2022] GET /identity/v3/endpoints?service_id=708700f118d445dda97cc031675a1e2c&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:03:04.436841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1363b8-7ee0-4f39-ab70-30e75bc12415 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:04.525376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:04.545189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1363b8-7ee0-4f39-ab70-30e75bc12415 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:04.581372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4286a-93e1-464b-9030-341a29bd164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:04.582093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4286a-93e1-464b-9030-341a29bd164a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:04.582252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4286a-93e1-464b-9030-341a29bd164a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:04.582525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4286a-93e1-464b-9030-341a29bd164a None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:04.583137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4286a-93e1-464b-9030-341a29bd164a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:04.584687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4286a-93e1-464b-9030-341a29bd164a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:04.592633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 640/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Aug 31 11:03:04 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:03:06.584023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8d6e-ced1-4ae5-aa1e-236504787b63 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.584657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8d6e-ced1-4ae5-aa1e-236504787b63 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.584657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8d6e-ced1-4ae5-aa1e-236504787b63 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.586505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 662/1302] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:03:06.591846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487d1e-ede5-4869-bfcc-1920b9919e1e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:06.595957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487d1e-ede5-4869-bfcc-1920b9919e1e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:06.595957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487d1e-ede5-4869-bfcc-1920b9919e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:06.611673 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8c487d1e-ede5-4869-bfcc-1920b9919e1e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:03:06.612906 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8c487d1e-ede5-4869-bfcc-1920b9919e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:06.683442 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 641/1303] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:03:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 11:03:06.954008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c8d6e-ced1-4ae5-aa1e-236504787b63 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.055536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:07.062342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c8d6e-ced1-4ae5-aa1e-236504787b63 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.097661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157a031-7f10-4f17-a2fc-123490c853df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.098291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157a031-7f10-4f17-a2fc-123490c853df None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.098560 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157a031-7f10-4f17-a2fc-123490c853df None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.098823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157a031-7f10-4f17-a2fc-123490c853df None admin] PATH_INFO: `/v3/services/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.099403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157a031-7f10-4f17-a2fc-123490c853df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.100819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157a031-7f10-4f17-a2fc-123490c853df None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8157a031-7f10-4f17-a2fc-123490c853df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 11:03:07.109686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 11:03:07.111022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 31 11:03:07.112197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 663/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Aug 31 11:03:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 11:03:07.117015 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c487d1e-ede5-4869-bfcc-1920b9919e1e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.196625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:07.219668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c487d1e-ede5-4869-bfcc-1920b9919e1e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.253965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a56a3-ef9f-4dcd-8628-be7f3ef801a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.254586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a56a3-ef9f-4dcd-8628-be7f3ef801a1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.254866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a56a3-ef9f-4dcd-8628-be7f3ef801a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.255140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a56a3-ef9f-4dcd-8628-be7f3ef801a1 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.255806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a56a3-ef9f-4dcd-8628-be7f3ef801a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:03:07.256113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a56a3-ef9f-4dcd-8628-be7f3ef801a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.258598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a56a3-ef9f-4dcd-8628-be7f3ef801a1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.264335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 642/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Aug 31 11:03:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:03:07.270204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157a031-7f10-4f17-a2fc-123490c853df None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:07.378919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157a031-7f10-4f17-a2fc-123490c853df None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:07.415436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bfb0b-abc3-42a8-ae91-4c4270190d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:07.416088 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bfb0b-abc3-42a8-ae91-4c4270190d60 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:07.416367 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bfb0b-abc3-42a8-ae91-4c4270190d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:07.416636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bfb0b-abc3-42a8-ae91-4c4270190d60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:07.417321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bfb0b-abc3-42a8-ae91-4c4270190d60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:07.418729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bfb0b-abc3-42a8-ae91-4c4270190d60 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:07.512646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 664/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:03:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:03:17.302027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=30 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:17.506750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:14.001274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d6fee-40c5-423d-aa15-986ece2a7f6d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:14.001829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d6fee-40c5-423d-aa15-986ece2a7f6d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:14.001829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d6fee-40c5-423d-aa15-986ece2a7f6d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:14.003496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 643/1307] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:14.008990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66bdf-8354-4d2e-a7f1-47424f50129e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:14.009869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66bdf-8354-4d2e-a7f1-47424f50129e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:14.010292 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66bdf-8354-4d2e-a7f1-47424f50129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:14.126515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-27d66bdf-8354-4d2e-a7f1-47424f50129e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:14.130783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-27d66bdf-8354-4d2e-a7f1-47424f50129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:14.345498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 665/1308] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:14.630766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd9b1c-ae2a-4159-ba74-3e30d7a9bdf5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:14.631108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd9b1c-ae2a-4159-ba74-3e30d7a9bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:14.631311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd9b1c-ae2a-4159-ba74-3e30d7a9bdf5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:14.632918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 644/1309] 10.222.0.13 () {54 vars in 965 bytes} [Wed Aug 31 11:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:14.638769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482e2f3-954c-4e60-8746-3e2ba5a803c7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:14.639244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482e2f3-954c-4e60-8746-3e2ba5a803c7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:14.639723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482e2f3-954c-4e60-8746-3e2ba5a803c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:14.741816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e482e2f3-954c-4e60-8746-3e2ba5a803c7 None None] MFA Rules not processed for user `041de16601f342c1a9b18003773a0856`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:14.743154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e482e2f3-954c-4e60-8746-3e2ba5a803c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:14.769075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:14.834424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 666/1310] 10.222.0.13 () {58 vars in 1062 bytes} [Wed Aug 31 11:12:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:14.845416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd9b1c-ae2a-4159-ba74-3e30d7a9bdf5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:14.847226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ccfd9b1c-ae2a-4159-ba74-3e30d7a9bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:14.976063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd9b1c-ae2a-4159-ba74-3e30d7a9bdf5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:15.062159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c425033-91c6-44cb-9e68-bf099b33caec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:15.064343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c425033-91c6-44cb-9e68-bf099b33caec service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:15.064839 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c425033-91c6-44cb-9e68-bf099b33caec service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:15.065293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c425033-91c6-44cb-9e68-bf099b33caec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:15.067150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0c425033-91c6-44cb-9e68-bf099b33caec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:15.129381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:15.188137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c425033-91c6-44cb-9e68-bf099b33caec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:15.189583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c425033-91c6-44cb-9e68-bf099b33caec service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:15.209627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 645/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:17.445446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2e9e4-dbd3-4458-9356-6cec6f005792 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:17.446003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2e9e4-dbd3-4458-9356-6cec6f005792 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:17.446003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2e9e4-dbd3-4458-9356-6cec6f005792 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:17.447467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 667/1312] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:17.452983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5857268-f9df-4208-9728-a6ec8c6808a1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:17.453383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5857268-f9df-4208-9728-a6ec8c6808a1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:17.453575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5857268-f9df-4208-9728-a6ec8c6808a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:17.545315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b5857268-f9df-4208-9728-a6ec8c6808a1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:17.545315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b5857268-f9df-4208-9728-a6ec8c6808a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:17.646495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 646/1313] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:17.942610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdda88-a31f-4add-9e1d-8142a5e75b7e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:17.942901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdda88-a31f-4add-9e1d-8142a5e75b7e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:17.943168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdda88-a31f-4add-9e1d-8142a5e75b7e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:17.944579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 668/1314] 10.222.0.13 () {54 vars in 965 bytes} [Wed Aug 31 11:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:17.951021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552f12-91b5-4e95-9238-36070d1b7430 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:17.951307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552f12-91b5-4e95-9238-36070d1b7430 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:17.951637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552f12-91b5-4e95-9238-36070d1b7430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:17.963516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:18.035535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ce552f12-91b5-4e95-9238-36070d1b7430 None None] MFA Rules not processed for user `041de16601f342c1a9b18003773a0856`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:18.036798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ce552f12-91b5-4e95-9238-36070d1b7430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:18.117407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 647/1315] 10.222.0.13 () {58 vars in 1062 bytes} [Wed Aug 31 11:12:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:18.126476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdda88-a31f-4add-9e1d-8142a5e75b7e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:18.128049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-30bdda88-a31f-4add-9e1d-8142a5e75b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:18.232424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdda88-a31f-4add-9e1d-8142a5e75b7e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:18.305382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:18.308074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb7083-c87f-437d-b226-241a4c4e3d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:18.308712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb7083-c87f-437d-b226-241a4c4e3d72 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:18.308988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb7083-c87f-437d-b226-241a4c4e3d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:18.309258 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb7083-c87f-437d-b226-241a4c4e3d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:18.311021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-11cb7083-c87f-437d-b226-241a4c4e3d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:18.418800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb7083-c87f-437d-b226-241a4c4e3d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:18.420356 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb7083-c87f-437d-b226-241a4c4e3d72 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:18.438766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 669/1316] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:21.562596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709bec-64e0-4379-a983-74fb298ba2f3 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:21.563123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709bec-64e0-4379-a983-74fb298ba2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:21.563123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709bec-64e0-4379-a983-74fb298ba2f3 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:21.564518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 648/1317] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:21.569696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827e68-bfbf-48f1-920e-f011bee539db None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:21.570147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827e68-bfbf-48f1-920e-f011bee539db None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:21.570251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827e68-bfbf-48f1-920e-f011bee539db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:21.635460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1e827e68-bfbf-48f1-920e-f011bee539db None None] MFA Rules not processed for user `732cad40509a4bc799b9ef3a107f5645`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:21.636704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1e827e68-bfbf-48f1-920e-f011bee539db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:21.687816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:21.730358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 670/1318] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:22.030405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709bec-64e0-4379-a983-74fb298ba2f3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:22.032061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e6709bec-64e0-4379-a983-74fb298ba2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:22.151676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709bec-64e0-4379-a983-74fb298ba2f3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:22.154561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:22.235110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67908974-d7c4-4ea5-b4f9-b8fa49e33d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:22.236502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908974-d7c4-4ea5-b4f9-b8fa49e33d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:22.236502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908974-d7c4-4ea5-b4f9-b8fa49e33d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:22.236502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908974-d7c4-4ea5-b4f9-b8fa49e33d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:22.238359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-67908974-d7c4-4ea5-b4f9-b8fa49e33d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:22.364616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67908974-d7c4-4ea5-b4f9-b8fa49e33d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:22.366050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67908974-d7c4-4ea5-b4f9-b8fa49e33d76 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:22.389677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 649/1319] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:25.259135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671a7f7-9c1a-4c42-937c-08c9fb6cc206 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:25.259665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671a7f7-9c1a-4c42-937c-08c9fb6cc206 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:25.259665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671a7f7-9c1a-4c42-937c-08c9fb6cc206 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:25.261065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 671/1320] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:25.267019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2869599-6ff1-45e8-ad44-926ca34f51cc None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:25.267426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2869599-6ff1-45e8-ad44-926ca34f51cc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:25.267570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2869599-6ff1-45e8-ad44-926ca34f51cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:25.308664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:25.335495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f2869599-6ff1-45e8-ad44-926ca34f51cc None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:25.337895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f2869599-6ff1-45e8-ad44-926ca34f51cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:25.444053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 650/1321] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:12:25.736230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671a7f7-9c1a-4c42-937c-08c9fb6cc206 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:25.737756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9671a7f7-9c1a-4c42-937c-08c9fb6cc206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:25.843788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671a7f7-9c1a-4c42-937c-08c9fb6cc206 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:25.917075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f482bc-b145-4f76-92f1-37222408311f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:25.917681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f482bc-b145-4f76-92f1-37222408311f service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:25.917960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f482bc-b145-4f76-92f1-37222408311f service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:25.918233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f482bc-b145-4f76-92f1-37222408311f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:25.919857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-74f482bc-b145-4f76-92f1-37222408311f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:25.928854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:26.030345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f482bc-b145-4f76-92f1-37222408311f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:26.031801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f482bc-b145-4f76-92f1-37222408311f service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:26.050437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 672/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:29.032846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810eead-f77c-4ead-bbd0-9c52cbee6a5e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:29.033488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810eead-f77c-4ead-bbd0-9c52cbee6a5e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:29.033488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810eead-f77c-4ead-bbd0-9c52cbee6a5e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:29.034901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 651/1323] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:29.039876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582e37a-ca30-4417-89f5-e8b61613b827 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:29.040341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582e37a-ca30-4417-89f5-e8b61613b827 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:29.040481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582e37a-ca30-4417-89f5-e8b61613b827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:29.108865 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1582e37a-ca30-4417-89f5-e8b61613b827 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:29.110082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1582e37a-ca30-4417-89f5-e8b61613b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:29.169058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:29.210155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 673/1324] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:29.499945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810eead-f77c-4ead-bbd0-9c52cbee6a5e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:29.501619 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1810eead-f77c-4ead-bbd0-9c52cbee6a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:29.626540 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810eead-f77c-4ead-bbd0-9c52cbee6a5e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:29.641006 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:29.707578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daebce-1e24-4314-8e3e-e363c2067645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:29.708227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daebce-1e24-4314-8e3e-e363c2067645 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:29.708505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daebce-1e24-4314-8e3e-e363c2067645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:29.708778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daebce-1e24-4314-8e3e-e363c2067645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:29.710464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d1daebce-1e24-4314-8e3e-e363c2067645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:29.829854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daebce-1e24-4314-8e3e-e363c2067645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:29.831292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daebce-1e24-4314-8e3e-e363c2067645 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:29.850363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 652/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:31.862071 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec86e07-1ba0-4318-b164-bcf73066d458 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:31.862609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec86e07-1ba0-4318-b164-bcf73066d458 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:31.862609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec86e07-1ba0-4318-b164-bcf73066d458 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:31.863907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 674/1326] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:31.869600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1640214-4200-4b42-85d4-140650caf59d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:31.870120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1640214-4200-4b42-85d4-140650caf59d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:31.870120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1640214-4200-4b42-85d4-140650caf59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:31.927363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:31.949925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f1640214-4200-4b42-85d4-140650caf59d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:31.951127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f1640214-4200-4b42-85d4-140650caf59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:32.054586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 653/1327] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:32.345727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec86e07-1ba0-4318-b164-bcf73066d458 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:32.345727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fec86e07-1ba0-4318-b164-bcf73066d458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:32.450135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec86e07-1ba0-4318-b164-bcf73066d458 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:32.525142 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055580b6-0269-4129-99f7-994c0e02cc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:32.525751 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055580b6-0269-4129-99f7-994c0e02cc7a service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:32.526030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055580b6-0269-4129-99f7-994c0e02cc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:32.526333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055580b6-0269-4129-99f7-994c0e02cc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:32.527977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-055580b6-0269-4129-99f7-994c0e02cc7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:32.547388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:32.645234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055580b6-0269-4129-99f7-994c0e02cc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:32.646691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055580b6-0269-4129-99f7-994c0e02cc7a service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:32.666483 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 675/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:34.647412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d85e2-c816-4537-8b28-2ce461810fe5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:34.647976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d85e2-c816-4537-8b28-2ce461810fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:34.648100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d85e2-c816-4537-8b28-2ce461810fe5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:34.649482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 654/1329] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:34.654722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab21c1-936e-48d1-8169-f318e1208934 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:34.655282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab21c1-936e-48d1-8169-f318e1208934 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:34.655282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab21c1-936e-48d1-8169-f318e1208934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:34.724363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-28ab21c1-936e-48d1-8169-f318e1208934 None None] MFA Rules not processed for user `732cad40509a4bc799b9ef3a107f5645`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:34.725619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-28ab21c1-936e-48d1-8169-f318e1208934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:34.798448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:34.832579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 676/1330] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:35.124974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d85e2-c816-4537-8b28-2ce461810fe5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:35.126509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-852d85e2-c816-4537-8b28-2ce461810fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:35.231080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d85e2-c816-4537-8b28-2ce461810fe5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:35.254304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:35.310949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc5243-f3d0-4b2c-bbd2-12c67666a4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:35.311655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc5243-f3d0-4b2c-bbd2-12c67666a4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:35.311970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc5243-f3d0-4b2c-bbd2-12c67666a4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:35.312242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc5243-f3d0-4b2c-bbd2-12c67666a4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:35.313834 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5ddc5243-f3d0-4b2c-bbd2-12c67666a4c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:35.442457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc5243-f3d0-4b2c-bbd2-12c67666a4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:35.443989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc5243-f3d0-4b2c-bbd2-12c67666a4c0 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:35.466417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 655/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:37.881636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270d6bb-4e7f-48fb-b8af-555f231f28f1 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:37.882145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270d6bb-4e7f-48fb-b8af-555f231f28f1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:37.882145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270d6bb-4e7f-48fb-b8af-555f231f28f1 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:37.883432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 677/1332] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:37.888480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42d73e-c77a-47c4-8d5e-ddb769d95940 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:37.888889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42d73e-c77a-47c4-8d5e-ddb769d95940 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:37.889037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42d73e-c77a-47c4-8d5e-ddb769d95940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:37.953079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:37.955645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4d42d73e-c77a-47c4-8d5e-ddb769d95940 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:37.956868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4d42d73e-c77a-47c4-8d5e-ddb769d95940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:38.052680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 656/1333] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:38.335620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270d6bb-4e7f-48fb-b8af-555f231f28f1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:38.338196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7270d6bb-4e7f-48fb-b8af-555f231f28f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:38.440531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270d6bb-4e7f-48fb-b8af-555f231f28f1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:38.517857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98772211-f069-4212-b495-6523e0ece9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:38.518460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772211-f069-4212-b495-6523e0ece9cd service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:38.518740 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772211-f069-4212-b495-6523e0ece9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:38.519013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772211-f069-4212-b495-6523e0ece9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:38.520657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-98772211-f069-4212-b495-6523e0ece9cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:38.547482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:38.630885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98772211-f069-4212-b495-6523e0ece9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:38.632379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98772211-f069-4212-b495-6523e0ece9cd service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:38.649900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 678/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:40.628584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f7694-3ba3-4cc8-8aa4-31b280be69c2 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:40.629163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f7694-3ba3-4cc8-8aa4-31b280be69c2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:40.629163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f7694-3ba3-4cc8-8aa4-31b280be69c2 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:40.630465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 657/1335] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:40.635619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574c87-6273-4a34-9fc7-3c3b7d734a87 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:40.636073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574c87-6273-4a34-9fc7-3c3b7d734a87 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:40.636313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574c87-6273-4a34-9fc7-3c3b7d734a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:40.703239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4e574c87-6273-4a34-9fc7-3c3b7d734a87 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:40.704489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4e574c87-6273-4a34-9fc7-3c3b7d734a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:40.786524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:40.809245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 679/1336] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:41.096522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f7694-3ba3-4cc8-8aa4-31b280be69c2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:41.099344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-050f7694-3ba3-4cc8-8aa4-31b280be69c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:41.207123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f7694-3ba3-4cc8-8aa4-31b280be69c2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:41.235029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:41.280264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b1b98-9d86-45aa-816f-000c60da10cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:41.280970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b1b98-9d86-45aa-816f-000c60da10cf service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:41.281212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b1b98-9d86-45aa-816f-000c60da10cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:41.282068 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b1b98-9d86-45aa-816f-000c60da10cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:41.283021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-799b1b98-9d86-45aa-816f-000c60da10cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:41.391952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b1b98-9d86-45aa-816f-000c60da10cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:41.393307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b1b98-9d86-45aa-816f-000c60da10cf service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:41.411975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 658/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:44.026341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3129-f148-447e-a841-92c19ab3af57 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:44.026915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3129-f148-447e-a841-92c19ab3af57 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:44.026915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3129-f148-447e-a841-92c19ab3af57 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:44.028451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 680/1338] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:44.034257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b29a9d-1b2d-45ed-9a46-ab9c571c9b6b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:44.034637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b29a9d-1b2d-45ed-9a46-ab9c571c9b6b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:44.034801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b29a9d-1b2d-45ed-9a46-ab9c571c9b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:44.101052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-83b29a9d-1b2d-45ed-9a46-ab9c571c9b6b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:44.102279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-83b29a9d-1b2d-45ed-9a46-ab9c571c9b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:44.110838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:44.212076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 659/1339] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:44.495691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3129-f148-447e-a841-92c19ab3af57 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:44.497288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-712b3129-f148-447e-a841-92c19ab3af57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:44.603796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3129-f148-447e-a841-92c19ab3af57 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:44.680400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823992-d098-41bc-8120-3d3d873cd933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:44.681004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823992-d098-41bc-8120-3d3d873cd933 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:44.681281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823992-d098-41bc-8120-3d3d873cd933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:44.681553 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823992-d098-41bc-8120-3d3d873cd933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:44.683152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-87823992-d098-41bc-8120-3d3d873cd933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:44.719856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:44.792897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87823992-d098-41bc-8120-3d3d873cd933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:44.794338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87823992-d098-41bc-8120-3d3d873cd933 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:44.812747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 681/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:48.983064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd868c-53ef-47b6-89a6-3df3feabefc1 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:48.983624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd868c-53ef-47b6-89a6-3df3feabefc1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:48.983624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd868c-53ef-47b6-89a6-3df3feabefc1 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:48.984984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 660/1341] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:48.990171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d89ef-16da-4285-a420-f2d16c58e2d1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:48.990583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d89ef-16da-4285-a420-f2d16c58e2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:48.990742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d89ef-16da-4285-a420-f2d16c58e2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:49.057919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-318d89ef-16da-4285-a420-f2d16c58e2d1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:49.059117 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-318d89ef-16da-4285-a420-f2d16c58e2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:49.151878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:49.163494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 682/1342] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:49.445546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd868c-53ef-47b6-89a6-3df3feabefc1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:49.447107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1dcd868c-53ef-47b6-89a6-3df3feabefc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:49.552278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd868c-53ef-47b6-89a6-3df3feabefc1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:49.599241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:49.637146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cf061-e29c-49e9-b48c-b01d79d08f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:49.637758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cf061-e29c-49e9-b48c-b01d79d08f89 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:49.638041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cf061-e29c-49e9-b48c-b01d79d08f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:49.638320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cf061-e29c-49e9-b48c-b01d79d08f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:49.641374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c89cf061-e29c-49e9-b48c-b01d79d08f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:49.757658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cf061-e29c-49e9-b48c-b01d79d08f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:49.759211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cf061-e29c-49e9-b48c-b01d79d08f89 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:49.777767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 661/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:52.829268 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c274b62-e549-4712-874a-648913ade7d7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:52.829863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c274b62-e549-4712-874a-648913ade7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:52.829863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c274b62-e549-4712-874a-648913ade7d7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:52.831164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 683/1344] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:52.836451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527760af-40c4-4ebc-b9bb-32477cd46dd7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:52.836922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527760af-40c4-4ebc-b9bb-32477cd46dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:52.837031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527760af-40c4-4ebc-b9bb-32477cd46dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:52.903196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-527760af-40c4-4ebc-b9bb-32477cd46dd7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:52.904673 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-527760af-40c4-4ebc-b9bb-32477cd46dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:52.923124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:53.003995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 662/1345] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:53.295729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c274b62-e549-4712-874a-648913ade7d7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:53.297446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3c274b62-e549-4712-874a-648913ade7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:53.406519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c274b62-e549-4712-874a-648913ade7d7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:53.487168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3820322-e5e6-40ea-8315-1a8e8e7deef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:53.487801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3820322-e5e6-40ea-8315-1a8e8e7deef3 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:53.488083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3820322-e5e6-40ea-8315-1a8e8e7deef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:53.488355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3820322-e5e6-40ea-8315-1a8e8e7deef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:53.489965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e3820322-e5e6-40ea-8315-1a8e8e7deef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:53.534932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:53.605309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3820322-e5e6-40ea-8315-1a8e8e7deef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:53.606777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3820322-e5e6-40ea-8315-1a8e8e7deef3 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:53.628208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 684/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:12:58.309817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363aaa-11ca-4c03-a669-a588ca57b4e4 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:58.310467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363aaa-11ca-4c03-a669-a588ca57b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:58.310580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363aaa-11ca-4c03-a669-a588ca57b4e4 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:58.314951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 663/1347] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:12:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:12:58.317648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1c6ad-ae1a-4bc8-b5c6-4234ba629654 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:58.318127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1c6ad-ae1a-4bc8-b5c6-4234ba629654 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:58.318223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1c6ad-ae1a-4bc8-b5c6-4234ba629654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:58.391650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0ee1c6ad-ae1a-4bc8-b5c6-4234ba629654 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:12:58.392946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0ee1c6ad-ae1a-4bc8-b5c6-4234ba629654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:58.494338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:58.497072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 685/1348] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:12:58.788417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363aaa-11ca-4c03-a669-a588ca57b4e4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:12:58.789926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9c363aaa-11ca-4c03-a669-a588ca57b4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:58.900916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363aaa-11ca-4c03-a669-a588ca57b4e4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:12:58.951226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:12:58.977502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af804850-2175-42df-bf5f-7a82221af143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:12:58.978098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804850-2175-42df-bf5f-7a82221af143 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:12:58.978378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804850-2175-42df-bf5f-7a82221af143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:12:58.978654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af804850-2175-42df-bf5f-7a82221af143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:12:58.980268 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-af804850-2175-42df-bf5f-7a82221af143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:12:59.088184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af804850-2175-42df-bf5f-7a82221af143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:12:59.089614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af804850-2175-42df-bf5f-7a82221af143 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:12:59.109253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 664/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:04.144275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1a42-be48-42e0-8891-02bbc025f6e9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:04.145170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1a42-be48-42e0-8891-02bbc025f6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:04.145937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1a42-be48-42e0-8891-02bbc025f6e9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:04.147096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 686/1350] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:04.152900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac6a0-021e-4166-9a21-581be50c20cb None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:04.153339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac6a0-021e-4166-9a21-581be50c20cb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:04.153522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac6a0-021e-4166-9a21-581be50c20cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:04.246255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-024ac6a0-021e-4166-9a21-581be50c20cb None None] MFA Rules not processed for user `cacc0855973047b6a97e40b5f32a8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:04.248787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-024ac6a0-021e-4166-9a21-581be50c20cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:04.277289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:04.426362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 665/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:13:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:08.587685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5737f-3456-45d1-8aba-d7d868dc1677 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:08.588325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5737f-3456-45d1-8aba-d7d868dc1677 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:08.588519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5737f-3456-45d1-8aba-d7d868dc1677 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:08.589936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 687/1352] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:08.595365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b205f42-852b-41a0-a928-0d7ea332f4f7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:08.595822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b205f42-852b-41a0-a928-0d7ea332f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:08.596202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b205f42-852b-41a0-a928-0d7ea332f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:08.675663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3b205f42-852b-41a0-a928-0d7ea332f4f7 None None] MFA Rules not processed for user `cacc0855973047b6a97e40b5f32a8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:08.677294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3b205f42-852b-41a0-a928-0d7ea332f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:08.754276 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:08.792837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 666/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:10.378365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8843f18-b7fd-403c-a7b6-1951c54587b4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:10.378908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8843f18-b7fd-403c-a7b6-1951c54587b4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:10.378908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8843f18-b7fd-403c-a7b6-1951c54587b4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:10.380257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 688/1354] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:10.385502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894e90e-092e-4a5c-9f4c-ddd783126c4d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:10.385916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894e90e-092e-4a5c-9f4c-ddd783126c4d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:10.386049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894e90e-092e-4a5c-9f4c-ddd783126c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:10.470443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1894e90e-092e-4a5c-9f4c-ddd783126c4d None None] MFA Rules not processed for user `cacc0855973047b6a97e40b5f32a8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:10.471653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1894e90e-092e-4a5c-9f4c-ddd783126c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:10.584109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 667/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:13:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:13:13.825030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dc0d6-1d8f-43c3-a911-fddfc87b4b31 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:13.826141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dc0d6-1d8f-43c3-a911-fddfc87b4b31 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:13.826141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dc0d6-1d8f-43c3-a911-fddfc87b4b31 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:13.827480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 689/1356] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:13.832603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e5b6-39e5-4141-8103-844fe0dd1c67 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:13.833071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e5b6-39e5-4141-8103-844fe0dd1c67 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:13.833196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e5b6-39e5-4141-8103-844fe0dd1c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:13.869995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:13.906949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e220e5b6-39e5-4141-8103-844fe0dd1c67 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:13.908180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e220e5b6-39e5-4141-8103-844fe0dd1c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:14.040960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 668/1357] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:14.355886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e862e-7ac7-44f7-b62d-eb2d831d11ac None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:14.356179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e862e-7ac7-44f7-b62d-eb2d831d11ac None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:14.356495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e862e-7ac7-44f7-b62d-eb2d831d11ac None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:14.358370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 690/1358] 10.222.0.13 () {54 vars in 962 bytes} [Wed Aug 31 11:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:14.370443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b181-01fd-4e3c-a98d-89b7eda2a48e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:14.370999 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b181-01fd-4e3c-a98d-89b7eda2a48e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:14.371574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b181-01fd-4e3c-a98d-89b7eda2a48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:14.464790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7968b181-01fd-4e3c-a98d-89b7eda2a48e None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:14.466314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7968b181-01fd-4e3c-a98d-89b7eda2a48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:14.520489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:14.592541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 669/1359] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Aug 31 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:14.600353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e862e-7ac7-44f7-b62d-eb2d831d11ac None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:14.602177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8e5e862e-7ac7-44f7-b62d-eb2d831d11ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:14.769177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e862e-7ac7-44f7-b62d-eb2d831d11ac None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:14.848988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:14.892291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00113e8b-40aa-4e76-b43d-0542ee305361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:14.892901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113e8b-40aa-4e76-b43d-0542ee305361 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:14.893186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113e8b-40aa-4e76-b43d-0542ee305361 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:14.893444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113e8b-40aa-4e76-b43d-0542ee305361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:14.895342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-00113e8b-40aa-4e76-b43d-0542ee305361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:14.993512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00113e8b-40aa-4e76-b43d-0542ee305361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:14.995360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00113e8b-40aa-4e76-b43d-0542ee305361 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:15.016697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 691/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:17.195851 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da044-9aa6-4339-ae8d-53743fa84df7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:17.196390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da044-9aa6-4339-ae8d-53743fa84df7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:17.196390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da044-9aa6-4339-ae8d-53743fa84df7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:17.197835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 670/1361] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:17.203094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01d79f-d8fa-4b6f-959e-0b13acb48581 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:17.203491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01d79f-d8fa-4b6f-959e-0b13acb48581 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:17.203693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01d79f-d8fa-4b6f-959e-0b13acb48581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:17.274803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5f01d79f-d8fa-4b6f-959e-0b13acb48581 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:17.275965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5f01d79f-d8fa-4b6f-959e-0b13acb48581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:17.320165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:17.388197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 692/1362] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:17.677976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da044-9aa6-4339-ae8d-53743fa84df7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:17.681148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-944da044-9aa6-4339-ae8d-53743fa84df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:17.851847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da044-9aa6-4339-ae8d-53743fa84df7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:17.864797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:17.978456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67195c05-99f1-49f9-bcf8-5ca0d98b5f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:17.979056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67195c05-99f1-49f9-bcf8-5ca0d98b5f4c service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:17.979331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67195c05-99f1-49f9-bcf8-5ca0d98b5f4c service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:17.979597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67195c05-99f1-49f9-bcf8-5ca0d98b5f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:17.981243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-67195c05-99f1-49f9-bcf8-5ca0d98b5f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:18.070820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67195c05-99f1-49f9-bcf8-5ca0d98b5f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:18.072373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67195c05-99f1-49f9-bcf8-5ca0d98b5f4c service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:18.093517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 671/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:20.513672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1594e-c666-407a-a647-bb89679e8934 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:20.514194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1594e-c666-407a-a647-bb89679e8934 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:20.514305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1594e-c666-407a-a647-bb89679e8934 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:20.515570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 693/1364] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:20.521093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c20f-ca22-4394-9431-d390c25b0fc9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:20.521553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c20f-ca22-4394-9431-d390c25b0fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:20.521649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c20f-ca22-4394-9431-d390c25b0fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:20.541319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:20.594916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a1e6c20f-ca22-4394-9431-d390c25b0fc9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:20.596175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a1e6c20f-ca22-4394-9431-d390c25b0fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:20.717869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 672/1365] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:21.024412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63c3f7-7398-4280-b834-f92570e6e569 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:21.024709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63c3f7-7398-4280-b834-f92570e6e569 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:21.025278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63c3f7-7398-4280-b834-f92570e6e569 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:21.026599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 694/1366] 10.222.0.13 () {54 vars in 962 bytes} [Wed Aug 31 11:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:21.032156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeba61-259f-453e-9bb2-39591b7ebedf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:21.032516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeba61-259f-453e-9bb2-39591b7ebedf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:21.032868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeba61-259f-453e-9bb2-39591b7ebedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:21.114584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6eaeba61-259f-453e-9bb2-39591b7ebedf None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:21.115718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6eaeba61-259f-453e-9bb2-39591b7ebedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:21.154047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:21.241652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 673/1367] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Aug 31 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:21.250828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63c3f7-7398-4280-b834-f92570e6e569 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:21.252559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ea63c3f7-7398-4280-b834-f92570e6e569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:21.415021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63c3f7-7398-4280-b834-f92570e6e569 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:21.437574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:21.547557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334032d-32a6-456f-ab21-56e617b0d2e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:21.548276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334032d-32a6-456f-ab21-56e617b0d2e0 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:21.548523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334032d-32a6-456f-ab21-56e617b0d2e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:21.548726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334032d-32a6-456f-ab21-56e617b0d2e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:21.550328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a334032d-32a6-456f-ab21-56e617b0d2e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:21.647330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334032d-32a6-456f-ab21-56e617b0d2e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:21.649014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334032d-32a6-456f-ab21-56e617b0d2e0 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:21.671474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 695/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:22.307811 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd9b19-7f14-467d-80e2-827a2fae0db5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:22.308353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd9b19-7f14-467d-80e2-827a2fae0db5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:22.308353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd9b19-7f14-467d-80e2-827a2fae0db5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:22.310633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 674/1369] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:22.315807 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ea13a-9258-49c4-a248-676b11215a04 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:22.316191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ea13a-9258-49c4-a248-676b11215a04 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:22.316464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ea13a-9258-49c4-a248-676b11215a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:22.351163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:22.389710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-342ea13a-9258-49c4-a248-676b11215a04 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:22.390908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-342ea13a-9258-49c4-a248-676b11215a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:22.499542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 696/1370] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:23.156420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d66a-8485-406d-a5c6-e6b003ad4960 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:23.156420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d66a-8485-406d-a5c6-e6b003ad4960 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:23.156420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d66a-8485-406d-a5c6-e6b003ad4960 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:23.158878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 675/1371] 10.222.0.13 () {54 vars in 964 bytes} [Wed Aug 31 11:13:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:23.164223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7996-4f6a-44b0-a8c3-593b5de955e4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:23.164753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7996-4f6a-44b0-a8c3-593b5de955e4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:23.164916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7996-4f6a-44b0-a8c3-593b5de955e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:23.262731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-82ed7996-4f6a-44b0-a8c3-593b5de955e4 None None] MFA Rules not processed for user `fae0faf062ba4b7a8270fc2ff92a10be`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:23.264341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-82ed7996-4f6a-44b0-a8c3-593b5de955e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:23.317157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:23.352100 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 697/1372] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Aug 31 11:13:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:23.361789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36d66a-8485-406d-a5c6-e6b003ad4960 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:23.363641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fe36d66a-8485-406d-a5c6-e6b003ad4960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:23.504761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36d66a-8485-406d-a5c6-e6b003ad4960 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:23.560826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:23.603439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35311237-26b2-4d6d-841d-0c537938cf86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:23.604972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311237-26b2-4d6d-841d-0c537938cf86 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:23.605120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311237-26b2-4d6d-841d-0c537938cf86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:23.605409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311237-26b2-4d6d-841d-0c537938cf86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:23.608777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-35311237-26b2-4d6d-841d-0c537938cf86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:23.740873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35311237-26b2-4d6d-841d-0c537938cf86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:23.742261 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35311237-26b2-4d6d-841d-0c537938cf86 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:23.772072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 676/1373] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:24.061016 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1e2f-beb6-4da5-82c1-af2456822d2c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:24.061434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1e2f-beb6-4da5-82c1-af2456822d2c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:24.061766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1e2f-beb6-4da5-82c1-af2456822d2c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:24.063179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 698/1374] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:24.068599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900bd03-a059-4917-ac75-fcb81b1acfd6 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:24.068893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900bd03-a059-4917-ac75-fcb81b1acfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:24.069168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900bd03-a059-4917-ac75-fcb81b1acfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:24.138254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0900bd03-a059-4917-ac75-fcb81b1acfd6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:24.139465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0900bd03-a059-4917-ac75-fcb81b1acfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:24.160223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:24.237296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 677/1375] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:24.526660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1e2f-beb6-4da5-82c1-af2456822d2c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:24.528949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-46da1e2f-beb6-4da5-82c1-af2456822d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:24.676841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1e2f-beb6-4da5-82c1-af2456822d2c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:24.728442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:24.803767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b72ff-4d64-4bcb-8957-10d2b8fc8a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:24.804406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b72ff-4d64-4bcb-8957-10d2b8fc8a13 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:24.804686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b72ff-4d64-4bcb-8957-10d2b8fc8a13 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:24.804956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b72ff-4d64-4bcb-8957-10d2b8fc8a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:24.806570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fa1b72ff-4d64-4bcb-8957-10d2b8fc8a13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:24.900417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b72ff-4d64-4bcb-8957-10d2b8fc8a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:24.902006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b72ff-4d64-4bcb-8957-10d2b8fc8a13 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:24.921131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 699/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:27.012845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f58d-b824-4b67-9028-80d4acc1e42c None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:27.013301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f58d-b824-4b67-9028-80d4acc1e42c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:27.013400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f58d-b824-4b67-9028-80d4acc1e42c None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:27.014749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 678/1377] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:27.020017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091b69-0b16-4b54-91ce-70c869cefb12 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:27.020426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091b69-0b16-4b54-91ce-70c869cefb12 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:27.020691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091b69-0b16-4b54-91ce-70c869cefb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:27.107122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0c091b69-0b16-4b54-91ce-70c869cefb12 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:27.108547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0c091b69-0b16-4b54-91ce-70c869cefb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:27.116805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:27.211353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 700/1378] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:27.508678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3f58d-b824-4b67-9028-80d4acc1e42c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:27.510183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c8a3f58d-b824-4b67-9028-80d4acc1e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:27.721972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3f58d-b824-4b67-9028-80d4acc1e42c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:27.726201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:27.862188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c6825-0fb2-4a73-b84f-12cba6534576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:27.862710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6825-0fb2-4a73-b84f-12cba6534576 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:27.862988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6825-0fb2-4a73-b84f-12cba6534576 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:27.863257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6825-0fb2-4a73-b84f-12cba6534576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:27.864864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6b6c6825-0fb2-4a73-b84f-12cba6534576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:27.964532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c6825-0fb2-4a73-b84f-12cba6534576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:27.967031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c6825-0fb2-4a73-b84f-12cba6534576 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:27.987947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 679/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:30.136672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6171204-ac8e-4517-b6fc-00770eb0bb77 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:30.137805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6171204-ac8e-4517-b6fc-00770eb0bb77 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:30.137805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6171204-ac8e-4517-b6fc-00770eb0bb77 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:30.139234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 701/1380] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:30.144568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c746-9ce5-47fa-9457-7a0fe9421454 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:30.145025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c746-9ce5-47fa-9457-7a0fe9421454 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:30.145115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c746-9ce5-47fa-9457-7a0fe9421454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:30.157738 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:30.224786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-45f7c746-9ce5-47fa-9457-7a0fe9421454 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:30.226135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-45f7c746-9ce5-47fa-9457-7a0fe9421454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:30.338570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 680/1381] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:30.640603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6171204-ac8e-4517-b6fc-00770eb0bb77 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:30.642119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d6171204-ac8e-4517-b6fc-00770eb0bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:30.793286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:30.804762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6171204-ac8e-4517-b6fc-00770eb0bb77 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:30.934902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a27933-a63a-4080-9dcf-6a23f84508f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:30.935429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27933-a63a-4080-9dcf-6a23f84508f0 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:30.935707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27933-a63a-4080-9dcf-6a23f84508f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:30.936012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27933-a63a-4080-9dcf-6a23f84508f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:30.937711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a6a27933-a63a-4080-9dcf-6a23f84508f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:31.034463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a27933-a63a-4080-9dcf-6a23f84508f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:31.036115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a27933-a63a-4080-9dcf-6a23f84508f0 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:31.047262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:31.056276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 702/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:33.167851 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a47bc-cbfe-494c-b7c4-f7e2122760a5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:33.168446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a47bc-cbfe-494c-b7c4-f7e2122760a5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:33.168539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a47bc-cbfe-494c-b7c4-f7e2122760a5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:33.169862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 681/1383] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:33.175407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a70f7-5e97-4df5-8455-ddec72b0ddfd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:33.175890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a70f7-5e97-4df5-8455-ddec72b0ddfd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:33.175987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a70f7-5e97-4df5-8455-ddec72b0ddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:33.261083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-925a70f7-5e97-4df5-8455-ddec72b0ddfd None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:33.263505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-925a70f7-5e97-4df5-8455-ddec72b0ddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:33.391078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 703/1384] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:33.680556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a47bc-cbfe-494c-b7c4-f7e2122760a5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:33.682057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fd1a47bc-cbfe-494c-b7c4-f7e2122760a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:33.784197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:33.853663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a47bc-cbfe-494c-b7c4-f7e2122760a5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:33.985464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dec4c-193c-49d8-815f-12ddce26ff83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:33.986484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dec4c-193c-49d8-815f-12ddce26ff83 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:33.986835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dec4c-193c-49d8-815f-12ddce26ff83 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:33.987175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dec4c-193c-49d8-815f-12ddce26ff83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:33.989339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-554dec4c-193c-49d8-815f-12ddce26ff83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:34.043295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:34.091947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dec4c-193c-49d8-815f-12ddce26ff83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:34.093543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dec4c-193c-49d8-815f-12ddce26ff83 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:34.113414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 682/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:36.146318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a28fd-4a61-43ca-9071-c846ea5f15f7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:36.146990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a28fd-4a61-43ca-9071-c846ea5f15f7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:36.146990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a28fd-4a61-43ca-9071-c846ea5f15f7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:36.148402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 704/1386] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:36.154066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8a6e-b8e2-4ff3-92dc-1daf90ba9180 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:36.154512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8a6e-b8e2-4ff3-92dc-1daf90ba9180 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:36.154615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b8a6e-b8e2-4ff3-92dc-1daf90ba9180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:36.224710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-465b8a6e-b8e2-4ff3-92dc-1daf90ba9180 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:36.225923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-465b8a6e-b8e2-4ff3-92dc-1daf90ba9180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:36.330966 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 683/1387] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:36.626385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a28fd-4a61-43ca-9071-c846ea5f15f7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:36.627947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-358a28fd-4a61-43ca-9071-c846ea5f15f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:36.705165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:36.781821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a28fd-4a61-43ca-9071-c846ea5f15f7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:36.898366 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51988ef8-0bb0-4064-9ded-90bb54a7a075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:36.898898 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988ef8-0bb0-4064-9ded-90bb54a7a075 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:36.899179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988ef8-0bb0-4064-9ded-90bb54a7a075 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:36.899452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988ef8-0bb0-4064-9ded-90bb54a7a075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:36.901099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-51988ef8-0bb0-4064-9ded-90bb54a7a075 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:36.942453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:36.999498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51988ef8-0bb0-4064-9ded-90bb54a7a075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:37.001171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51988ef8-0bb0-4064-9ded-90bb54a7a075 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:37.019372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 705/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:39.126051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c45a0a-367a-45c2-98b3-f5943937879e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:39.126624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c45a0a-367a-45c2-98b3-f5943937879e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:39.126624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c45a0a-367a-45c2-98b3-f5943937879e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:39.128130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 684/1389] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:39.133131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2865b7-4b73-409c-b9a1-833cf01fe380 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:39.133562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2865b7-4b73-409c-b9a1-833cf01fe380 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:39.133680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2865b7-4b73-409c-b9a1-833cf01fe380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:39.204539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fa2865b7-4b73-409c-b9a1-833cf01fe380 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:39.205753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fa2865b7-4b73-409c-b9a1-833cf01fe380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:39.306862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 706/1390] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:39.598050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c45a0a-367a-45c2-98b3-f5943937879e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:39.600184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-23c45a0a-367a-45c2-98b3-f5943937879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:39.631929 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:39.685484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99172c-4a62-4f7f-8f2c-852eae16bff8 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:39.685774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99172c-4a62-4f7f-8f2c-852eae16bff8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:39.686074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99172c-4a62-4f7f-8f2c-852eae16bff8 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:39.687464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 707/1391] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:13:39.692593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a416ea-e6a7-4749-bec6-38e53cbd4cec None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:39.692875 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a416ea-e6a7-4749-bec6-38e53cbd4cec None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:39.693140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a416ea-e6a7-4749-bec6-38e53cbd4cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:39.709582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:39.755497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c45a0a-367a-45c2-98b3-f5943937879e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:39.763831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-13a416ea-e6a7-4749-bec6-38e53cbd4cec None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:39.765095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-13a416ea-e6a7-4749-bec6-38e53cbd4cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:39.859792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:39.863138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 708/1392] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:13:39.871990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610fa9c-cc63-4841-86db-9254f5238ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:39.872597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610fa9c-cc63-4841-86db-9254f5238ebe service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:39.872872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610fa9c-cc63-4841-86db-9254f5238ebe service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:39.873260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610fa9c-cc63-4841-86db-9254f5238ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:39.874752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3610fa9c-cc63-4841-86db-9254f5238ebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:39.967494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610fa9c-cc63-4841-86db-9254f5238ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:39.969277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610fa9c-cc63-4841-86db-9254f5238ebe service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:39.988770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 685/1393] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:40.168422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016f051-434b-4344-88bc-9b9125c94b2c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:40.168908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016f051-434b-4344-88bc-9b9125c94b2c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:40.169061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016f051-434b-4344-88bc-9b9125c94b2c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:40.170417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 709/1394] 10.222.0.13 () {54 vars in 967 bytes} [Wed Aug 31 11:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:40.176792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313bb9-e028-499a-bebc-692eec64914d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:40.177243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313bb9-e028-499a-bebc-692eec64914d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:40.184273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313bb9-e028-499a-bebc-692eec64914d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:40.268338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-02313bb9-e028-499a-bebc-692eec64914d None None] MFA Rules not processed for user `a8855e3e7fc84cd9ba1afaef4cc308c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:40.269679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-02313bb9-e028-499a-bebc-692eec64914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:40.327860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:40.351382 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 686/1395] 10.222.0.13 () {58 vars in 1064 bytes} [Wed Aug 31 11:13:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:40.359923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016f051-434b-4344-88bc-9b9125c94b2c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:40.361439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7016f051-434b-4344-88bc-9b9125c94b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:40.463517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:40.471201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016f051-434b-4344-88bc-9b9125c94b2c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:40.552121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1aeaf-bd8c-4b74-89fd-b6c786c85e61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8855e3e7fc84cd9ba1afaef4cc308c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:40.552733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1aeaf-bd8c-4b74-89fd-b6c786c85e61 service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:40.553012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1aeaf-bd8c-4b74-89fd-b6c786c85e61 service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:40.553282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1aeaf-bd8c-4b74-89fd-b6c786c85e61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:40.554892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2ca1aeaf-bd8c-4b74-89fd-b6c786c85e61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:40.667039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1aeaf-bd8c-4b74-89fd-b6c786c85e61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:40.668731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1aeaf-bd8c-4b74-89fd-b6c786c85e61 service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:40.688115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 710/1396] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:41.670922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a2b1e-7907-4b64-b6e9-a16c3f288709 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:41.671461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a2b1e-7907-4b64-b6e9-a16c3f288709 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:41.671461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a2b1e-7907-4b64-b6e9-a16c3f288709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:41.741633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-520a2b1e-7907-4b64-b6e9-a16c3f288709 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:41.742770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-520a2b1e-7907-4b64-b6e9-a16c3f288709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:41.831478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 687/1397] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:13:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:41.879881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b8fbd-634c-4097-9d20-62ca87ddcc4c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:41.880370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b8fbd-634c-4097-9d20-62ca87ddcc4c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:41.880475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b8fbd-634c-4097-9d20-62ca87ddcc4c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:41.881757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 711/1398] 10.222.0.13 () {54 vars in 943 bytes} [Wed Aug 31 11:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:41.888141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ef5aa-a12b-4e9d-82df-e92a8ee6be73 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:41.888435 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ef5aa-a12b-4e9d-82df-e92a8ee6be73 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:41.888714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ef5aa-a12b-4e9d-82df-e92a8ee6be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:41.967957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9a4ef5aa-a12b-4e9d-82df-e92a8ee6be73 None None] MFA Rules not processed for user `62c91e3eec414a5189befb91012955c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:41.969150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9a4ef5aa-a12b-4e9d-82df-e92a8ee6be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:41.982534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:42.078724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 688/1399] 10.222.0.13 () {58 vars in 1040 bytes} [Wed Aug 31 11:13:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:42.088201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b8fbd-634c-4097-9d20-62ca87ddcc4c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:42.089780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9c3b8fbd-634c-4097-9d20-62ca87ddcc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:42.113879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec9340-7c2b-46d6-b32c-3ff6ab4acdeb None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:42.114164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec9340-7c2b-46d6-b32c-3ff6ab4acdeb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:42.114441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec9340-7c2b-46d6-b32c-3ff6ab4acdeb None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:42.115420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:42.116029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 689/1400] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:13:42.121813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb93516-a75b-4ec3-8f02-e201cd57a4ed None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:42.122093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb93516-a75b-4ec3-8f02-e201cd57a4ed None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:42.122369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb93516-a75b-4ec3-8f02-e201cd57a4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:42.200451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-efb93516-a75b-4ec3-8f02-e201cd57a4ed None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:42.201670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-efb93516-a75b-4ec3-8f02-e201cd57a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:42.235829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b8fbd-634c-4097-9d20-62ca87ddcc4c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:42.277564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:42.300957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 690/1401] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:13:42.349959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f695712-0e65-4eb6-ab6a-4054eec7cb5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:42.350484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f695712-0e65-4eb6-ab6a-4054eec7cb5c service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:42.350761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f695712-0e65-4eb6-ab6a-4054eec7cb5c service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:42.351032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f695712-0e65-4eb6-ab6a-4054eec7cb5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:42.352710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2f695712-0e65-4eb6-ab6a-4054eec7cb5c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:42.361220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:42.439173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f695712-0e65-4eb6-ab6a-4054eec7cb5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:42.440821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f695712-0e65-4eb6-ab6a-4054eec7cb5c service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:42.449536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 712/1402] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:13:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:13:42.595946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb93516-a75b-4ec3-8f02-e201cd57a4ed None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:42.597187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-efb93516-a75b-4ec3-8f02-e201cd57a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:42.708921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb93516-a75b-4ec3-8f02-e201cd57a4ed None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:42.798003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:42.826096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8caae6-3763-4ee1-9437-10816d331658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:42.826934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8caae6-3763-4ee1-9437-10816d331658 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:42.827614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8caae6-3763-4ee1-9437-10816d331658 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:42.827937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8caae6-3763-4ee1-9437-10816d331658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:42.829906 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bf8caae6-3763-4ee1-9437-10816d331658 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:42.921029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8caae6-3763-4ee1-9437-10816d331658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:42.922781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8caae6-3763-4ee1-9437-10816d331658 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:42.941681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 691/1403] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:45.074750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47888187-3f85-45f4-946f-ababb4c944e8 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:45.075419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47888187-3f85-45f4-946f-ababb4c944e8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:45.075419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47888187-3f85-45f4-946f-ababb4c944e8 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:45.080092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 713/1404] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:45.081821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63778280-2d80-40a9-9f11-681ee3e6502a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:45.082409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63778280-2d80-40a9-9f11-681ee3e6502a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:45.082409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63778280-2d80-40a9-9f11-681ee3e6502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:45.163898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-63778280-2d80-40a9-9f11-681ee3e6502a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:45.165123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-63778280-2d80-40a9-9f11-681ee3e6502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:45.224988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:45.273246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 692/1405] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:45.578323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47888187-3f85-45f4-946f-ababb4c944e8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:45.579929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-47888187-3f85-45f4-946f-ababb4c944e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:45.760868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47888187-3f85-45f4-946f-ababb4c944e8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:45.764516 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:45.900645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c5ae1-5212-407d-87e6-f9305d690961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:45.901315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c5ae1-5212-407d-87e6-f9305d690961 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:45.902273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c5ae1-5212-407d-87e6-f9305d690961 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:45.902638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c5ae1-5212-407d-87e6-f9305d690961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:45.904514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b94c5ae1-5212-407d-87e6-f9305d690961 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:46.016879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c5ae1-5212-407d-87e6-f9305d690961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:46.018840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c5ae1-5212-407d-87e6-f9305d690961 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:46.039465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 714/1406] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:48.245830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569c4e1-3cc9-4e46-b7e8-2d497d7b2ece None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:48.246528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569c4e1-3cc9-4e46-b7e8-2d497d7b2ece None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:48.246528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569c4e1-3cc9-4e46-b7e8-2d497d7b2ece None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:48.248076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 693/1407] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:13:48.253232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0457b72-825a-4844-9e0e-3c915f48a715 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:48.253738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0457b72-825a-4844-9e0e-3c915f48a715 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:48.253834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0457b72-825a-4844-9e0e-3c915f48a715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:48.264014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:48.329836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d0457b72-825a-4844-9e0e-3c915f48a715 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:13:48.331063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d0457b72-825a-4844-9e0e-3c915f48a715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:48.448132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 715/1408] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:13:48.746046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569c4e1-3cc9-4e46-b7e8-2d497d7b2ece None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:13:48.747702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c569c4e1-3cc9-4e46-b7e8-2d497d7b2ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:48.928068 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569c4e1-3cc9-4e46-b7e8-2d497d7b2ece None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:13:48.973404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:49.060695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a8412-e37e-4ee7-9e48-bf49f4623a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:13:49.061317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a8412-e37e-4ee7-9e48-bf49f4623a96 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:13:49.061575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a8412-e37e-4ee7-9e48-bf49f4623a96 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:13:49.061845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a8412-e37e-4ee7-9e48-bf49f4623a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:13:49.063463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b25a8412-e37e-4ee7-9e48-bf49f4623a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:13:49.165701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a8412-e37e-4ee7-9e48-bf49f4623a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:13:49.167361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a8412-e37e-4ee7-9e48-bf49f4623a96 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:13:49.188132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 694/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:13:58.443591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=62 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:13:59.185047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=82 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:06.209179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a59c64-60cc-421f-a74d-a739b7166d91 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:06.209747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a59c64-60cc-421f-a74d-a739b7166d91 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:06.209747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a59c64-60cc-421f-a74d-a739b7166d91 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:06.211113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 716/1410] 10.222.0.13 () {54 vars in 918 bytes} [Wed Aug 31 11:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:06.217107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb58e7e-28e8-4534-b4e7-94da5c777339 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:06.217530 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb58e7e-28e8-4534-b4e7-94da5c777339 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:06.217696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb58e7e-28e8-4534-b4e7-94da5c777339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:06.302535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3cb58e7e-28e8-4534-b4e7-94da5c777339 None None] MFA Rules not processed for user `cacc0855973047b6a97e40b5f32a8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:06.303883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3cb58e7e-28e8-4534-b4e7-94da5c777339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:06.420359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 695/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Aug 31 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:06.435073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622ba8b-3aac-4ce5-b598-dd428e966b22 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:06.435353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622ba8b-3aac-4ce5-b598-dd428e966b22 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:06.435624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622ba8b-3aac-4ce5-b598-dd428e966b22 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:06.436983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 717/1412] 10.222.0.13 () {54 vars in 918 bytes} [Wed Aug 31 11:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:06.441660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e86e9f-fb5d-4036-a2b0-dd2dadf91902 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:06.441952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e86e9f-fb5d-4036-a2b0-dd2dadf91902 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:06.442227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e86e9f-fb5d-4036-a2b0-dd2dadf91902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:06.515288 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:06.517840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e2e86e9f-fb5d-4036-a2b0-dd2dadf91902 None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:06.519053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e2e86e9f-fb5d-4036-a2b0-dd2dadf91902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:06.635572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 696/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Aug 31 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:14:09.008209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860e282-e2ae-4310-9bfb-ef266bdccadd None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:09.008759 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860e282-e2ae-4310-9bfb-ef266bdccadd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:09.008759 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860e282-e2ae-4310-9bfb-ef266bdccadd None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:09.010028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:09.015784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16170a1c-eb89-4aff-9a84-b91eed22812a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:09.016216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16170a1c-eb89-4aff-9a84-b91eed22812a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:09.016345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16170a1c-eb89-4aff-9a84-b91eed22812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:09.083367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-16170a1c-eb89-4aff-9a84-b91eed22812a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:09.084623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-16170a1c-eb89-4aff-9a84-b91eed22812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:09.139649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:09.183320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:09.473719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860e282-e2ae-4310-9bfb-ef266bdccadd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:09.475255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6860e282-e2ae-4310-9bfb-ef266bdccadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:09.621890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860e282-e2ae-4310-9bfb-ef266bdccadd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:09.694503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:09.737152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0c3ea-53c6-4a27-bff6-4ef08d4acf77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:09.737755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0c3ea-53c6-4a27-bff6-4ef08d4acf77 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:09.738029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0c3ea-53c6-4a27-bff6-4ef08d4acf77 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:09.738294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0c3ea-53c6-4a27-bff6-4ef08d4acf77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:09.739913 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-52d0c3ea-53c6-4a27-bff6-4ef08d4acf77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:09.830032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0c3ea-53c6-4a27-bff6-4ef08d4acf77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:09.831644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0c3ea-53c6-4a27-bff6-4ef08d4acf77 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:09.849266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 719/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:10.751681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa016c1-23fb-450f-a6aa-5b2c8eb0e4d5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:10.752128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa016c1-23fb-450f-a6aa-5b2c8eb0e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:10.752291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa016c1-23fb-450f-a6aa-5b2c8eb0e4d5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:10.753676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:10.758679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de6a89-8377-46db-9d29-23924484ff46 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:10.767346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de6a89-8377-46db-9d29-23924484ff46 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:10.767346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de6a89-8377-46db-9d29-23924484ff46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:10.836808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c9de6a89-8377-46db-9d29-23924484ff46 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:10.838079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c9de6a89-8377-46db-9d29-23924484ff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:10.865355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:10.934939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:11.093360 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa016c1-23fb-450f-a6aa-5b2c8eb0e4d5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:11.094939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9aa016c1-23fb-450f-a6aa-5b2c8eb0e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:11.357751 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa016c1-23fb-450f-a6aa-5b2c8eb0e4d5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:11.398152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:11.471543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae313ae7-74d2-46fb-9a00-f9afe5997a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:11.472182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae313ae7-74d2-46fb-9a00-f9afe5997a44 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:11.472459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae313ae7-74d2-46fb-9a00-f9afe5997a44 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:11.472727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae313ae7-74d2-46fb-9a00-f9afe5997a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:11.474304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ae313ae7-74d2-46fb-9a00-f9afe5997a44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:11.562277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae313ae7-74d2-46fb-9a00-f9afe5997a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:11.563919 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae313ae7-74d2-46fb-9a00-f9afe5997a44 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:11.582117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 699/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:12.466194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4379410-9b88-4b91-9842-b85b0861ec93 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:12.466699 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4379410-9b88-4b91-9842-b85b0861ec93 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:12.466868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4379410-9b88-4b91-9842-b85b0861ec93 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:12.468234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:12.473232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eed65c-ae85-4b5a-aab8-0a7334d0dc4d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:12.473694 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eed65c-ae85-4b5a-aab8-0a7334d0dc4d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:12.473793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eed65c-ae85-4b5a-aab8-0a7334d0dc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:12.529280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:12.551187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-45eed65c-ae85-4b5a-aab8-0a7334d0dc4d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:12.552680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-45eed65c-ae85-4b5a-aab8-0a7334d0dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:12.652164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:12.803785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4379410-9b88-4b91-9842-b85b0861ec93 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:12.805092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a4379410-9b88-4b91-9842-b85b0861ec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:12.951434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4379410-9b88-4b91-9842-b85b0861ec93 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:12.963446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:13.068086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c1e9-3ef9-4b3f-aa82-1a2d33da4d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:13.068637 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c1e9-3ef9-4b3f-aa82-1a2d33da4d02 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:13.068908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c1e9-3ef9-4b3f-aa82-1a2d33da4d02 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:13.069175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c1e9-3ef9-4b3f-aa82-1a2d33da4d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:13.070864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d889c1e9-3ef9-4b3f-aa82-1a2d33da4d02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:13.159133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889c1e9-3ef9-4b3f-aa82-1a2d33da4d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:13.160798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889c1e9-3ef9-4b3f-aa82-1a2d33da4d02 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:13.179253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 722/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:14.049688 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61a524-763d-4f49-b756-b146d7772162 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:14.050229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61a524-763d-4f49-b756-b146d7772162 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:14.050229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61a524-763d-4f49-b756-b146d7772162 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:14.051866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:14.057109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c975d-b364-4ca4-a1a6-39c4f972f6fb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:14.057617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c975d-b364-4ca4-a1a6-39c4f972f6fb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:14.057731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c975d-b364-4ca4-a1a6-39c4f972f6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:14.077684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:14.133159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-359c975d-b364-4ca4-a1a6-39c4f972f6fb None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:14.134370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-359c975d-b364-4ca4-a1a6-39c4f972f6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:14.231813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:14.385578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61a524-763d-4f49-b756-b146d7772162 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:14.387002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8f61a524-763d-4f49-b756-b146d7772162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:14.500636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:14.538213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61a524-763d-4f49-b756-b146d7772162 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:14.654128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f582c-7447-473e-b33e-99b73ea94abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:14.654649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f582c-7447-473e-b33e-99b73ea94abc service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:14.654924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f582c-7447-473e-b33e-99b73ea94abc service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:14.655191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f582c-7447-473e-b33e-99b73ea94abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:14.656825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-449f582c-7447-473e-b33e-99b73ea94abc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:14.731997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:14.745710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f582c-7447-473e-b33e-99b73ea94abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:14.747504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f582c-7447-473e-b33e-99b73ea94abc service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:14.766058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 702/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:15.635121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86684dc-664f-4643-9ec4-09390bc15de5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:15.635634 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86684dc-664f-4643-9ec4-09390bc15de5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:15.635734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86684dc-664f-4643-9ec4-09390bc15de5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:15.637097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:15.642010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cc012-ee9e-4804-8c6d-877257f2eee8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:15.642426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cc012-ee9e-4804-8c6d-877257f2eee8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:15.642574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cc012-ee9e-4804-8c6d-877257f2eee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:15.718567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-508cc012-ee9e-4804-8c6d-877257f2eee8 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:15.719779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-508cc012-ee9e-4804-8c6d-877257f2eee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:15.818051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:15.972046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86684dc-664f-4643-9ec4-09390bc15de5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:15.973623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c86684dc-664f-4643-9ec4-09390bc15de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:16.075818 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:16.138507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86684dc-664f-4643-9ec4-09390bc15de5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:16.256562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c60356-0fb2-4757-9c9f-452edcb5de9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:16.257206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c60356-0fb2-4757-9c9f-452edcb5de9f service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:16.257522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c60356-0fb2-4757-9c9f-452edcb5de9f service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:16.257792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c60356-0fb2-4757-9c9f-452edcb5de9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:16.260084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a1c60356-0fb2-4757-9c9f-452edcb5de9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:16.314559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:16.355369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c60356-0fb2-4757-9c9f-452edcb5de9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:16.357360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c60356-0fb2-4757-9c9f-452edcb5de9f service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:16.376955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 725/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:17.232353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1990fc7-803b-475a-9e1d-2a17ca420e04 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:17.232977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1990fc7-803b-475a-9e1d-2a17ca420e04 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:17.232977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1990fc7-803b-475a-9e1d-2a17ca420e04 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:17.234217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:17.239017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664798-bdb6-4baa-bc1c-84aaff2872b1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:17.239432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664798-bdb6-4baa-bc1c-84aaff2872b1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:17.239569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664798-bdb6-4baa-bc1c-84aaff2872b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:17.316802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-40664798-bdb6-4baa-bc1c-84aaff2872b1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:17.318010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-40664798-bdb6-4baa-bc1c-84aaff2872b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:17.416802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:17.570304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1990fc7-803b-475a-9e1d-2a17ca420e04 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:17.571854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f1990fc7-803b-475a-9e1d-2a17ca420e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:17.620246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:17.723658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1990fc7-803b-475a-9e1d-2a17ca420e04 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:17.837475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617995d-c307-4b0c-a9bf-22002de32d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:17.838119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617995d-c307-4b0c-a9bf-22002de32d30 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:17.838390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617995d-c307-4b0c-a9bf-22002de32d30 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:17.838656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617995d-c307-4b0c-a9bf-22002de32d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:17.840275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a617995d-c307-4b0c-a9bf-22002de32d30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:17.847098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:17.929726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617995d-c307-4b0c-a9bf-22002de32d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:17.931312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617995d-c307-4b0c-a9bf-22002de32d30 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:17.950702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 705/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:18.840516 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bed9c-1d76-4db2-a3c1-0d117ca862a3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:18.841096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bed9c-1d76-4db2-a3c1-0d117ca862a3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:18.841096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bed9c-1d76-4db2-a3c1-0d117ca862a3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:18.842391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:18.847490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2294a-5a67-4cdb-b6b2-2af7d2e08103 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:18.847963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2294a-5a67-4cdb-b6b2-2af7d2e08103 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:18.848071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2294a-5a67-4cdb-b6b2-2af7d2e08103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:18.924948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b2e2294a-5a67-4cdb-b6b2-2af7d2e08103 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:18.926197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b2e2294a-5a67-4cdb-b6b2-2af7d2e08103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:18.996016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:19.024826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:19.176936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bed9c-1d76-4db2-a3c1-0d117ca862a3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:19.178382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0c8bed9c-1d76-4db2-a3c1-0d117ca862a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:19.195597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:19.324167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bed9c-1d76-4db2-a3c1-0d117ca862a3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:19.411354 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:19.447928 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d1cff-3af9-4aab-9daa-bba625561cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:19.448491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d1cff-3af9-4aab-9daa-bba625561cb6 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:19.448764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d1cff-3af9-4aab-9daa-bba625561cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:19.449032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d1cff-3af9-4aab-9daa-bba625561cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:19.450659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a48d1cff-3af9-4aab-9daa-bba625561cb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:19.540282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d1cff-3af9-4aab-9daa-bba625561cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:19.542177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d1cff-3af9-4aab-9daa-bba625561cb6 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:19.560983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 728/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:20.456660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f58f-72d9-44a7-b085-c20df0fbbb87 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:20.457237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f58f-72d9-44a7-b085-c20df0fbbb87 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:20.457659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f58f-72d9-44a7-b085-c20df0fbbb87 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:20.459898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:20.465356 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aabc0-dcd4-4b6a-a155-c1470e7b8de5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:20.465832 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aabc0-dcd4-4b6a-a155-c1470e7b8de5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:20.465944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aabc0-dcd4-4b6a-a155-c1470e7b8de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:20.544046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bc8aabc0-dcd4-4b6a-a155-c1470e7b8de5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:20.545184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bc8aabc0-dcd4-4b6a-a155-c1470e7b8de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:20.588793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:20.643786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:20.794444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f58f-72d9-44a7-b085-c20df0fbbb87 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:20.795924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2845f58f-72d9-44a7-b085-c20df0fbbb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:20.941415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f58f-72d9-44a7-b085-c20df0fbbb87 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:20.994738 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:21.053449 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ad991-5807-4354-a29d-98647eb9c849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:21.054048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ad991-5807-4354-a29d-98647eb9c849 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:21.054324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ad991-5807-4354-a29d-98647eb9c849 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:21.054589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ad991-5807-4354-a29d-98647eb9c849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:21.056187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b52ad991-5807-4354-a29d-98647eb9c849 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:21.142425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ad991-5807-4354-a29d-98647eb9c849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:21.144026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ad991-5807-4354-a29d-98647eb9c849 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:21.162255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 708/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:22.071448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25443550-d354-4bdb-a220-cb4760311594 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:22.072548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25443550-d354-4bdb-a220-cb4760311594 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:22.072893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25443550-d354-4bdb-a220-cb4760311594 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:22.074410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:22.079289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a0dc5-948d-4206-9d09-679c73899864 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:22.079768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a0dc5-948d-4206-9d09-679c73899864 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:22.079887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a0dc5-948d-4206-9d09-679c73899864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:22.155068 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-113a0dc5-948d-4206-9d09-679c73899864 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:22.156302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-113a0dc5-948d-4206-9d09-679c73899864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:22.158397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:22.255259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:14:22.412706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25443550-d354-4bdb-a220-cb4760311594 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:22.414124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25443550-d354-4bdb-a220-cb4760311594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:22.560344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25443550-d354-4bdb-a220-cb4760311594 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:22.587868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:22.679847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322fa0a-0023-49f2-9bd7-7a41ce54ff21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:22.680384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322fa0a-0023-49f2-9bd7-7a41ce54ff21 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:22.680687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322fa0a-0023-49f2-9bd7-7a41ce54ff21 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:22.680953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322fa0a-0023-49f2-9bd7-7a41ce54ff21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:22.683190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e322fa0a-0023-49f2-9bd7-7a41ce54ff21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:22.769859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322fa0a-0023-49f2-9bd7-7a41ce54ff21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:22.771432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322fa0a-0023-49f2-9bd7-7a41ce54ff21 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:22.789012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 731/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:24.816853 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a78103-83f1-4223-b185-5c8f43195739 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:24.817447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a78103-83f1-4223-b185-5c8f43195739 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:24.817447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a78103-83f1-4223-b185-5c8f43195739 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:24.818742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:24.825161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f7463-7b88-4ddc-98da-467c2a2789da None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:24.825652 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f7463-7b88-4ddc-98da-467c2a2789da None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:24.825764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f7463-7b88-4ddc-98da-467c2a2789da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:24.866425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:24.893707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9f3f7463-7b88-4ddc-98da-467c2a2789da None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:24.895565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9f3f7463-7b88-4ddc-98da-467c2a2789da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:24.990767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:25.275194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a78103-83f1-4223-b185-5c8f43195739 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:25.276876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e4a78103-83f1-4223-b185-5c8f43195739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:25.380459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a78103-83f1-4223-b185-5c8f43195739 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:25.411770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:25.454570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83139ab-6dea-464a-88f1-6d47b9a2dd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:25.455177 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83139ab-6dea-464a-88f1-6d47b9a2dd8d service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:25.455454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83139ab-6dea-464a-88f1-6d47b9a2dd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:25.455766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83139ab-6dea-464a-88f1-6d47b9a2dd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:25.457533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c83139ab-6dea-464a-88f1-6d47b9a2dd8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:25.566119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83139ab-6dea-464a-88f1-6d47b9a2dd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:25.567791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83139ab-6dea-464a-88f1-6d47b9a2dd8d service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:25.586795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 711/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:27.644847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d7da3-ea00-4d7f-92df-0b449970be66 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:27.645317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d7da3-ea00-4d7f-92df-0b449970be66 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:27.645421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d7da3-ea00-4d7f-92df-0b449970be66 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:27.646737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:27.652833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fb372-3e28-49eb-aea6-cb5428cb634b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:27.653231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fb372-3e28-49eb-aea6-cb5428cb634b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:27.653386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fb372-3e28-49eb-aea6-cb5428cb634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:27.720265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-fa0fb372-3e28-49eb-aea6-cb5428cb634b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:27.721481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fa0fb372-3e28-49eb-aea6-cb5428cb634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:27.734549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:27.823708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:28.111381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d7da3-ea00-4d7f-92df-0b449970be66 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:28.112972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c43d7da3-ea00-4d7f-92df-0b449970be66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:28.216983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d7da3-ea00-4d7f-92df-0b449970be66 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:28.229682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:28.292879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3e540-eded-4540-bb5b-ba9bd39e4181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:28.293485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3e540-eded-4540-bb5b-ba9bd39e4181 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:28.293760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3e540-eded-4540-bb5b-ba9bd39e4181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:28.294031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3e540-eded-4540-bb5b-ba9bd39e4181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:28.295618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-48c3e540-eded-4540-bb5b-ba9bd39e4181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:28.414017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3e540-eded-4540-bb5b-ba9bd39e4181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:28.415924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3e540-eded-4540-bb5b-ba9bd39e4181 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:28.434332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 734/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:31.000061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b2124-c113-4aa2-b763-b00c2ac4e698 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:31.000647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b2124-c113-4aa2-b763-b00c2ac4e698 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:31.000647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b2124-c113-4aa2-b763-b00c2ac4e698 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:31.001952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:14:31.007224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3d710-fec5-48d8-b51f-78abf127d517 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:31.007671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3d710-fec5-48d8-b51f-78abf127d517 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:31.007802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3d710-fec5-48d8-b51f-78abf127d517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:31.056468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:31.075252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4df3d710-fec5-48d8-b51f-78abf127d517 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:31.076544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4df3d710-fec5-48d8-b51f-78abf127d517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:31.172080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:31.465891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b2124-c113-4aa2-b763-b00c2ac4e698 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:31.467482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-443b2124-c113-4aa2-b763-b00c2ac4e698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:31.570397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b2124-c113-4aa2-b763-b00c2ac4e698 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:31.610084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:31.645347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67304c3e-488e-4654-902b-a54e45165735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:31.645952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67304c3e-488e-4654-902b-a54e45165735 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:31.646226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67304c3e-488e-4654-902b-a54e45165735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:31.646495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67304c3e-488e-4654-902b-a54e45165735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:31.648096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-67304c3e-488e-4654-902b-a54e45165735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:31.759601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67304c3e-488e-4654-902b-a54e45165735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:31.761073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67304c3e-488e-4654-902b-a54e45165735 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:31.779699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 714/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:33.866677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8b98-31cf-4c34-bc3a-c5290e7e9f8c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:33.867236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8b98-31cf-4c34-bc3a-c5290e7e9f8c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:33.867236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8b98-31cf-4c34-bc3a-c5290e7e9f8c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:33.869126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:33.874483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9733e2e-2a18-4192-a2e2-8db48649c6c5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:33.874900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9733e2e-2a18-4192-a2e2-8db48649c6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:33.875033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9733e2e-2a18-4192-a2e2-8db48649c6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:33.940947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e9733e2e-2a18-4192-a2e2-8db48649c6c5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:33.942079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e9733e2e-2a18-4192-a2e2-8db48649c6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:33.963510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:34.042969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:14:34.326184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b8b98-31cf-4c34-bc3a-c5290e7e9f8c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:34.327772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-823b8b98-31cf-4c34-bc3a-c5290e7e9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:34.431870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b8b98-31cf-4c34-bc3a-c5290e7e9f8c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:34.451920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:34.506292 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e817c15-81c4-4022-adc1-dce0c75c7d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:34.506889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e817c15-81c4-4022-adc1-dce0c75c7d05 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:34.507161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e817c15-81c4-4022-adc1-dce0c75c7d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:34.507436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e817c15-81c4-4022-adc1-dce0c75c7d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:34.509642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6e817c15-81c4-4022-adc1-dce0c75c7d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:34.622060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e817c15-81c4-4022-adc1-dce0c75c7d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:34.623501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e817c15-81c4-4022-adc1-dce0c75c7d05 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:34.641678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 737/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:36.632769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf9c5-9021-40f4-94fa-f8677046d4f1 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:36.633313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf9c5-9021-40f4-94fa-f8677046d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:36.633313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf9c5-9021-40f4-94fa-f8677046d4f1 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:36.635433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:36.640695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b0dcc-35ca-46ad-9e05-22bf0a1f4a58 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:36.641150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b0dcc-35ca-46ad-9e05-22bf0a1f4a58 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:36.641260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b0dcc-35ca-46ad-9e05-22bf0a1f4a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:36.706264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:36.708866 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6e9b0dcc-35ca-46ad-9e05-22bf0a1f4a58 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:36.710081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6e9b0dcc-35ca-46ad-9e05-22bf0a1f4a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:36.812614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:37.095680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf9c5-9021-40f4-94fa-f8677046d4f1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:37.097291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-969cf9c5-9021-40f4-94fa-f8677046d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:37.201113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf9c5-9021-40f4-94fa-f8677046d4f1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:37.249090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:37.273945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d7d8a-c71e-411f-aef0-449b28d38dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:37.274632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d7d8a-c71e-411f-aef0-449b28d38dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:37.274868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d7d8a-c71e-411f-aef0-449b28d38dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:37.275147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d7d8a-c71e-411f-aef0-449b28d38dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:37.276789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f06d7d8a-c71e-411f-aef0-449b28d38dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:37.385948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d7d8a-c71e-411f-aef0-449b28d38dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:37.387299 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d7d8a-c71e-411f-aef0-449b28d38dd4 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:37.405554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 717/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:39.373085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762c597-b13d-4e2e-85a8-93c856affeb7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:39.373664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762c597-b13d-4e2e-85a8-93c856affeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:39.373664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762c597-b13d-4e2e-85a8-93c856affeb7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:39.375031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:39.380416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a08f-dcbb-434f-b43a-ad87b4edeb12 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:39.380839 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a08f-dcbb-434f-b43a-ad87b4edeb12 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:39.380967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a08f-dcbb-434f-b43a-ad87b4edeb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:39.449528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1d39a08f-dcbb-434f-b43a-ad87b4edeb12 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:39.450725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1d39a08f-dcbb-434f-b43a-ad87b4edeb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:39.480269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:39.548382 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:39.834013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762c597-b13d-4e2e-85a8-93c856affeb7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:39.835548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d762c597-b13d-4e2e-85a8-93c856affeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:39.937494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762c597-b13d-4e2e-85a8-93c856affeb7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:39.966652 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:40.012716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf46cb1-9b08-4a0c-a887-81cab8bf1a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:40.013314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf46cb1-9b08-4a0c-a887-81cab8bf1a94 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:40.013588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf46cb1-9b08-4a0c-a887-81cab8bf1a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:40.013856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf46cb1-9b08-4a0c-a887-81cab8bf1a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:40.015434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1bf46cb1-9b08-4a0c-a887-81cab8bf1a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:40.128370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf46cb1-9b08-4a0c-a887-81cab8bf1a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:40.129722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf46cb1-9b08-4a0c-a887-81cab8bf1a94 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:40.147830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 740/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:42.093597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba143b3-b94b-4acc-bc5d-7fa590d95b10 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:42.094179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba143b3-b94b-4acc-bc5d-7fa590d95b10 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:42.094179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba143b3-b94b-4acc-bc5d-7fa590d95b10 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:42.095658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:42.100981 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71159c-2412-4979-ab7e-e34f9662027c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:42.101425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71159c-2412-4979-ab7e-e34f9662027c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:42.101524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71159c-2412-4979-ab7e-e34f9662027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:42.167197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7a71159c-2412-4979-ab7e-e34f9662027c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:42.168424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7a71159c-2412-4979-ab7e-e34f9662027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:42.176903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:42.267242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:42.553099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba143b3-b94b-4acc-bc5d-7fa590d95b10 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:42.554745 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bba143b3-b94b-4acc-bc5d-7fa590d95b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:42.659520 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba143b3-b94b-4acc-bc5d-7fa590d95b10 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:42.715335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:42.733794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac0419-45a2-4b83-b445-4ce06a1f98a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:42.734395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac0419-45a2-4b83-b445-4ce06a1f98a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:42.734671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac0419-45a2-4b83-b445-4ce06a1f98a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:42.734942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac0419-45a2-4b83-b445-4ce06a1f98a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:42.736553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9dac0419-45a2-4b83-b445-4ce06a1f98a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:42.846952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac0419-45a2-4b83-b445-4ce06a1f98a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:42.848407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac0419-45a2-4b83-b445-4ce06a1f98a2 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:42.870612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 720/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:44.844616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f717d1-7830-4106-a594-c777803071b3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:44.845214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f717d1-7830-4106-a594-c777803071b3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:44.845214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f717d1-7830-4106-a594-c777803071b3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:44.846497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:44.851701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57b8d9-2bb2-4294-a376-ebfcf866e086 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:44.852392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57b8d9-2bb2-4294-a376-ebfcf866e086 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:44.852392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57b8d9-2bb2-4294-a376-ebfcf866e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:44.918803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9c57b8d9-2bb2-4294-a376-ebfcf866e086 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:44.920044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9c57b8d9-2bb2-4294-a376-ebfcf866e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:44.959258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:45.018760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:45.309195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f717d1-7830-4106-a594-c777803071b3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:45.310728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d4f717d1-7830-4106-a594-c777803071b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:45.412357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f717d1-7830-4106-a594-c777803071b3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:45.450881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:45.487421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62fbdc-f22b-4565-a934-05117061e12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:45.488057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62fbdc-f22b-4565-a934-05117061e12a service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:45.488332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62fbdc-f22b-4565-a934-05117061e12a service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:45.488600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62fbdc-f22b-4565-a934-05117061e12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:45.490190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2b62fbdc-f22b-4565-a934-05117061e12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:45.599173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62fbdc-f22b-4565-a934-05117061e12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:45.600638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62fbdc-f22b-4565-a934-05117061e12a service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:45.618892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 743/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:47.617218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754099-1037-411f-9d34-bcaf74837860 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:47.617907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754099-1037-411f-9d34-bcaf74837860 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:47.617907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754099-1037-411f-9d34-bcaf74837860 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:47.619139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:47.624752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554cdc-6e28-4b16-8902-54efbbd53cc2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:47.625201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554cdc-6e28-4b16-8902-54efbbd53cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:47.625336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554cdc-6e28-4b16-8902-54efbbd53cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:47.692120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2d554cdc-6e28-4b16-8902-54efbbd53cc2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:47.693337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2d554cdc-6e28-4b16-8902-54efbbd53cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:47.712103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:47.790544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:48.074516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754099-1037-411f-9d34-bcaf74837860 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:48.076055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6d754099-1037-411f-9d34-bcaf74837860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:48.182800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754099-1037-411f-9d34-bcaf74837860 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:48.249191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:48.255562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac0fa1-4ceb-4b5d-bf28-5732f5d8d754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:48.256194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0fa1-4ceb-4b5d-bf28-5732f5d8d754 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:48.256470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0fa1-4ceb-4b5d-bf28-5732f5d8d754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:48.256737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0fa1-4ceb-4b5d-bf28-5732f5d8d754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:48.258935 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4bac0fa1-4ceb-4b5d-bf28-5732f5d8d754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:48.366663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac0fa1-4ceb-4b5d-bf28-5732f5d8d754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:48.368664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac0fa1-4ceb-4b5d-bf28-5732f5d8d754 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:48.386404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 723/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:14:50.368673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655d8f5-f056-49ac-8573-b95a003185ff None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:50.369242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655d8f5-f056-49ac-8573-b95a003185ff None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:50.369242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655d8f5-f056-49ac-8573-b95a003185ff None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:50.370573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:14:50.375896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1765e-3b3b-44d0-b5b3-21d7a773d6fe None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:50.376327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1765e-3b3b-44d0-b5b3-21d7a773d6fe None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:50.376440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1765e-3b3b-44d0-b5b3-21d7a773d6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:50.442198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-58b1765e-3b3b-44d0-b5b3-21d7a773d6fe None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:14:50.443393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-58b1765e-3b3b-44d0-b5b3-21d7a773d6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:50.504116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:50.559005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:14:50.858496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655d8f5-f056-49ac-8573-b95a003185ff None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:14:50.860456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d655d8f5-f056-49ac-8573-b95a003185ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:50.971209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655d8f5-f056-49ac-8573-b95a003185ff None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:14:51.020046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:14:51.045341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70f22f-b7a7-4a46-a6ea-f54d8e9d3267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:14:51.045942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70f22f-b7a7-4a46-a6ea-f54d8e9d3267 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:14:51.046220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70f22f-b7a7-4a46-a6ea-f54d8e9d3267 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:14:51.046486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70f22f-b7a7-4a46-a6ea-f54d8e9d3267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:14:51.048092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2a70f22f-b7a7-4a46-a6ea-f54d8e9d3267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:14:51.155359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70f22f-b7a7-4a46-a6ea-f54d8e9d3267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:14:51.156750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70f22f-b7a7-4a46-a6ea-f54d8e9d3267 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:14:51.175048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 746/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:15:00.558763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=22 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:01.172787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=66 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:10.802991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe00863-1eb6-41d5-a85f-7c97e7be4f4f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:10.803447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe00863-1eb6-41d5-a85f-7c97e7be4f4f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:10.803552 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe00863-1eb6-41d5-a85f-7c97e7be4f4f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:10.805492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 725/1471] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:15:10.810797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60766eea-9e16-4831-87c2-08ee8fbc079e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:10.811217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60766eea-9e16-4831-87c2-08ee8fbc079e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:10.811332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60766eea-9e16-4831-87c2-08ee8fbc079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:10.879660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-60766eea-9e16-4831-87c2-08ee8fbc079e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:15:10.880926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-60766eea-9e16-4831-87c2-08ee8fbc079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:10.979197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 747/1472] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:15:11.282068 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce84fa-1af2-4b8f-bf05-b9808153155e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:11.282205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce84fa-1af2-4b8f-bf05-b9808153155e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:11.282427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce84fa-1af2-4b8f-bf05-b9808153155e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:11.283771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 726/1473] 10.222.0.13 () {54 vars in 967 bytes} [Wed Aug 31 11:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:15:11.288866 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5938-fbd8-453e-b9c7-532761e7c331 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:11.289153 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5938-fbd8-453e-b9c7-532761e7c331 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:11.289433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5938-fbd8-453e-b9c7-532761e7c331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:11.364983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-eb1a5938-fbd8-453e-b9c7-532761e7c331 None None] MFA Rules not processed for user `a8855e3e7fc84cd9ba1afaef4cc308c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:15:11.366211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eb1a5938-fbd8-453e-b9c7-532761e7c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:11.388793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:11.445426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 748/1474] 10.222.0.13 () {58 vars in 1064 bytes} [Wed Aug 31 11:15:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:15:11.453053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce84fa-1af2-4b8f-bf05-b9808153155e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:15:11.454585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-59ce84fa-1af2-4b8f-bf05-b9808153155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:11.559410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce84fa-1af2-4b8f-bf05-b9808153155e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:15:11.633022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefd6ec-1929-4f1b-902c-b72fa51faea7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8855e3e7fc84cd9ba1afaef4cc308c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:15:11.633615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefd6ec-1929-4f1b-902c-b72fa51faea7 service glance] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:11.633892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefd6ec-1929-4f1b-902c-b72fa51faea7 service glance] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:11.634160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefd6ec-1929-4f1b-902c-b72fa51faea7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:11.635734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fdefd6ec-1929-4f1b-902c-b72fa51faea7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:11.690602 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:11.744009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefd6ec-1929-4f1b-902c-b72fa51faea7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:15:11.745568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefd6ec-1929-4f1b-902c-b72fa51faea7 service glance] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:15:11.764163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 727/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:15:13.803682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6f61d-a1d3-4097-913f-c9b4d17819d7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:13.804998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6f61d-a1d3-4097-913f-c9b4d17819d7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:13.804998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6f61d-a1d3-4097-913f-c9b4d17819d7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:13.806155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 749/1476] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:15:13.811606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3522d-8667-4a95-8299-49667cc9ef76 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:13.812048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3522d-8667-4a95-8299-49667cc9ef76 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:13.812204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3522d-8667-4a95-8299-49667cc9ef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:13.878877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2bf3522d-8667-4a95-8299-49667cc9ef76 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:15:13.880110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2bf3522d-8667-4a95-8299-49667cc9ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:13.978454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 728/1477] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:15:14.248460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6f61d-a1d3-4097-913f-c9b4d17819d7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:15:14.249931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c6e6f61d-a1d3-4097-913f-c9b4d17819d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:14.377267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6f61d-a1d3-4097-913f-c9b4d17819d7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:15:14.426980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:14.471854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d254-5cdc-41d1-904f-3cd3f23a4555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:15:14.472460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d254-5cdc-41d1-904f-3cd3f23a4555 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:14.472752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d254-5cdc-41d1-904f-3cd3f23a4555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:14.473003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d254-5cdc-41d1-904f-3cd3f23a4555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:14.473660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8d254-5cdc-41d1-904f-3cd3f23a4555 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:15:14.475461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-81e8d254-5cdc-41d1-904f-3cd3f23a4555 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:15:14.475461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 31 11:15:14.475461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: Aug 31 11:15:14.476670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8d254-5cdc-41d1-904f-3cd3f23a4555 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:15:14.495822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 750/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Aug 31 11:15:14 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:15:16.426096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409f21-8b21-414c-8cce-b9a7f3559f3e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:16.426634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409f21-8b21-414c-8cce-b9a7f3559f3e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:16.426634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409f21-8b21-414c-8cce-b9a7f3559f3e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:16.428319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 729/1479] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:15:16.434144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072692-c579-426b-b0c9-a79ed6c5f0c0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:16.434571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072692-c579-426b-b0c9-a79ed6c5f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:16.434680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072692-c579-426b-b0c9-a79ed6c5f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:16.501607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2c072692-c579-426b-b0c9-a79ed6c5f0c0 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:15:16.502879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2c072692-c579-426b-b0c9-a79ed6c5f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:16.602156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 751/1480] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:15:16.910679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409f21-8b21-414c-8cce-b9a7f3559f3e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:15:16.912234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0c409f21-8b21-414c-8cce-b9a7f3559f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:16.922355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:17.060409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409f21-8b21-414c-8cce-b9a7f3559f3e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:15:17.140021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:17.171871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bf8f1-cfd6-4e66-b91c-d2d74129330f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:15:17.172401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf8f1-cfd6-4e66-b91c-d2d74129330f service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:17.172676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf8f1-cfd6-4e66-b91c-d2d74129330f service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:17.172942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf8f1-cfd6-4e66-b91c-d2d74129330f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:17.174530 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f60bf8f1-cfd6-4e66-b91c-d2d74129330f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:17.266095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bf8f1-cfd6-4e66-b91c-d2d74129330f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:15:17.267668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bf8f1-cfd6-4e66-b91c-d2d74129330f service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:15:17.285350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 730/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:15:19.389047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b987b9-29d2-4e7f-a712-0b69f5527578 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:19.389650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b987b9-29d2-4e7f-a712-0b69f5527578 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:19.389650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b987b9-29d2-4e7f-a712-0b69f5527578 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:19.390917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 752/1482] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:15:19.396086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd639a-3a50-4dac-9b5e-817cd661e577 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:19.396544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd639a-3a50-4dac-9b5e-817cd661e577 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:19.396653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd639a-3a50-4dac-9b5e-817cd661e577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:19.461970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4cbd639a-3a50-4dac-9b5e-817cd661e577 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:15:19.463171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4cbd639a-3a50-4dac-9b5e-817cd661e577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:19.509211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:19.560020 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 731/1483] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:15:19.849511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b987b9-29d2-4e7f-a712-0b69f5527578 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:15:19.851627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d3b987b9-29d2-4e7f-a712-0b69f5527578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:19.875552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:19.954052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b987b9-29d2-4e7f-a712-0b69f5527578 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:15:20.032199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54294c3-725c-4a3e-9ec3-7021e9e99432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:15:20.032814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54294c3-725c-4a3e-9ec3-7021e9e99432 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:20.033094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54294c3-725c-4a3e-9ec3-7021e9e99432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:20.033371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54294c3-725c-4a3e-9ec3-7021e9e99432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:20.035956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d54294c3-725c-4a3e-9ec3-7021e9e99432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:20.116722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:20.151785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54294c3-725c-4a3e-9ec3-7021e9e99432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:15:20.153235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54294c3-725c-4a3e-9ec3-7021e9e99432 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:15:20.171643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 753/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:15:22.180080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b047ee-bccd-473b-a2b5-97afc425c4e1 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:22.180661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b047ee-bccd-473b-a2b5-97afc425c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:22.180661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b047ee-bccd-473b-a2b5-97afc425c4e1 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:22.182014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 732/1485] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:15:22.187113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be713b-01c3-4b6d-8017-345e4805e42f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:22.187517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be713b-01c3-4b6d-8017-345e4805e42f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:22.187666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be713b-01c3-4b6d-8017-345e4805e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:22.254057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d5be713b-01c3-4b6d-8017-345e4805e42f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:15:22.255282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d5be713b-01c3-4b6d-8017-345e4805e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:22.352519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 754/1486] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:15:22.644551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b047ee-bccd-473b-a2b5-97afc425c4e1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:15:22.646081 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b9b047ee-bccd-473b-a2b5-97afc425c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:22.750586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b047ee-bccd-473b-a2b5-97afc425c4e1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:15:22.821922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:22.823708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e4d5-0675-4f5d-b8cc-f580a5624940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:15:22.824337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e4d5-0675-4f5d-b8cc-f580a5624940 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:22.824615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e4d5-0675-4f5d-b8cc-f580a5624940 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:22.824886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e4d5-0675-4f5d-b8cc-f580a5624940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:22.826469 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6974e4d5-0675-4f5d-b8cc-f580a5624940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:22.935650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974e4d5-0675-4f5d-b8cc-f580a5624940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:15:22.937021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974e4d5-0675-4f5d-b8cc-f580a5624940 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:15:22.954994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 733/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:15:25.124321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b041a-5fc2-4016-a8ca-0d1cabe44432 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:25.124908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b041a-5fc2-4016-a8ca-0d1cabe44432 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:25.124908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b041a-5fc2-4016-a8ca-0d1cabe44432 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:25.126226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 755/1488] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:15:25.132387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831d8e-c8c9-4871-8dab-f520f4e4b0d0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:25.132903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831d8e-c8c9-4871-8dab-f520f4e4b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:25.133008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831d8e-c8c9-4871-8dab-f520f4e4b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:25.217232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ed831d8e-c8c9-4871-8dab-f520f4e4b0d0 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:15:25.219575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ed831d8e-c8c9-4871-8dab-f520f4e4b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:25.289915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:25.346416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 734/1489] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:15:25.709661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b041a-5fc2-4016-a8ca-0d1cabe44432 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:15:25.711375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-885b041a-5fc2-4016-a8ca-0d1cabe44432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:25.749844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:25.943076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b041a-5fc2-4016-a8ca-0d1cabe44432 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:15:26.015562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd22925-6ddb-4147-88c0-ef3befdb86fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:15:26.016191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22925-6ddb-4147-88c0-ef3befdb86fa service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:26.016460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22925-6ddb-4147-88c0-ef3befdb86fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:26.016725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22925-6ddb-4147-88c0-ef3befdb86fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:26.018331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9dd22925-6ddb-4147-88c0-ef3befdb86fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:26.103386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:26.133391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd22925-6ddb-4147-88c0-ef3befdb86fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:15:26.134838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd22925-6ddb-4147-88c0-ef3befdb86fa service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:15:26.153507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 756/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:15:28.567110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278bc15-5423-42d5-8704-a3e781286cba None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:28.567662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278bc15-5423-42d5-8704-a3e781286cba None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:28.567662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278bc15-5423-42d5-8704-a3e781286cba None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:28.569725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 735/1491] 10.222.0.13 () {54 vars in 927 bytes} [Wed Aug 31 11:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:15:28.575170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b0e62-57b1-4778-ad07-1297c5c41f53 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:28.575702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b0e62-57b1-4778-ad07-1297c5c41f53 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:28.575856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b0e62-57b1-4778-ad07-1297c5c41f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:28.640680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e81b0e62-57b1-4778-ad07-1297c5c41f53 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:15:28.641876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e81b0e62-57b1-4778-ad07-1297c5c41f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:28.738065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 757/1492] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Aug 31 11:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:15:29.030413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278bc15-5423-42d5-8704-a3e781286cba None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:15:29.031980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5278bc15-5423-42d5-8704-a3e781286cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:29.141308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278bc15-5423-42d5-8704-a3e781286cba None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:15:29.213988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300d6e2-e7da-4e65-9e86-260a33bf47b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:15:29.214583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d6e2-e7da-4e65-9e86-260a33bf47b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:15:29.214859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d6e2-e7da-4e65-9e86-260a33bf47b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:15:29.215127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d6e2-e7da-4e65-9e86-260a33bf47b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:15:29.216730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8300d6e2-e7da-4e65-9e86-260a33bf47b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:15:29.225816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:29.327265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d6e2-e7da-4e65-9e86-260a33bf47b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:15:29.328715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d6e2-e7da-4e65-9e86-260a33bf47b5 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:15:29.346293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 736/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:15:38.736213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=82 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:15:39.344064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=50 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:53.572816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd31f2-6d18-46ea-9575-c52ef822318f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:53.573410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd31f2-6d18-46ea-9575-c52ef822318f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:53.573410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd31f2-6d18-46ea-9575-c52ef822318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:53.650320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4bbd31f2-6d18-46ea-9575-c52ef822318f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:16:53.651508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4bbd31f2-6d18-46ea-9575-c52ef822318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:53.745346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 758/1494] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:16:53.753571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7c9b5-eb66-4ce7-93da-f30e8daa44b7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:53.754084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7c9b5-eb66-4ce7-93da-f30e8daa44b7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:53.754292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7c9b5-eb66-4ce7-93da-f30e8daa44b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:53.832373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f6f7c9b5-eb66-4ce7-93da-f30e8daa44b7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:16:53.833486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f6f7c9b5-eb66-4ce7-93da-f30e8daa44b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:53.930506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 737/1495] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:16:53.935267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd31f2-6d18-46ea-9575-c52ef822318f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:53.936536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4bbd31f2-6d18-46ea-9575-c52ef822318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:53.948518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd31f2-6d18-46ea-9575-c52ef822318f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:54.010988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:54.044274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:54.044874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:54.045144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:54.045406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:54.046037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:16:54.046332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:54.047330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:16:54.047330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 31 11:16:54.047330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: Aug 31 11:16:54.048250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:54.060504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 759/1496] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:16:54.068942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7c9b5-eb66-4ce7-93da-f30e8daa44b7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:54.078165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7c9b5-eb66-4ce7-93da-f30e8daa44b7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:54.139824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:54.173061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:54.173661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:54.174004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:54.174275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:54.174964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:54.177606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:16:54.177606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 31 11:16:54.177606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: Aug 31 11:16:54.178788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:54.367067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 738/1497] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:16:54 2022] POST /identity/v3/projects => generated 377 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:16:54.371052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:54.372675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:54.406121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42241c7b-bdac-42f5-8553-cdd0f7eeb9d4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:54.501118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:54.501729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:54.502001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:54.502270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:54.502904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:54.504592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:16:54.504592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 31 11:16:54.504592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: Aug 31 11:16:54.506042 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:54.698129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 760/1498] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:16:54 2022] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:16:54.702278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:54.703840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:54.767572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffbfe8-d157-4a84-8446-9094aca11956 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:54.853340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:54.864812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:54.867560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:54.867560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:54.867560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:54.867560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:54.867993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:16:54.867993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 31 11:16:54.867993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: Aug 31 11:16:54.868606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:54.882568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 739/1499] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:16:54.886563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:54.888297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:54.900937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e24024-83af-4773-b593-ba1dbc317033 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:54.928409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:54.999386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1bb37-2efd-4e9c-81f1-c455755cdfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:54.999924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1bb37-2efd-4e9c-81f1-c455755cdfbc admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:55.000200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1bb37-2efd-4e9c-81f1-c455755cdfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:55.000471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1bb37-2efd-4e9c-81f1-c455755cdfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:55.001107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1bb37-2efd-4e9c-81f1-c455755cdfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:55.002122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-b2c1bb37-2efd-4e9c-81f1-c455755cdfbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:16:55.002122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 31 11:16:55.002122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: Aug 31 11:16:55.003004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1bb37-2efd-4e9c-81f1-c455755cdfbc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:55.016032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 761/1500] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:16:55.020205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:55.021708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:55.057736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93ba38-3e9c-4f6d-bf2f-d8060a90e7bf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:55.153675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3649e-a5d1-43b9-b786-9992f82e2fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:55.154324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3649e-a5d1-43b9-b786-9992f82e2fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:55.154597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3649e-a5d1-43b9-b786-9992f82e2fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:55.154863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3649e-a5d1-43b9-b786-9992f82e2fd4 admin admin] PATH_INFO: `/v3/projects/c86362e975db4197bb3710e9122e72b8/users/9a230fe92ac24db3a086a3ec23b5049a/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:55.177883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3649e-a5d1-43b9-b786-9992f82e2fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86362e975db4197bb3710e9122e72b8, user_id=9a230fe92ac24db3a086a3ec23b5049a, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:55.178900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-7fd3649e-a5d1-43b9-b786-9992f82e2fd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:16:55.178900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 31 11:16:55.178900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: Aug 31 11:16:55.180857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3649e-a5d1-43b9-b786-9992f82e2fd4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:55.314561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 740/1501] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:16:55 2022] PUT /identity/v3/projects/c86362e975db4197bb3710e9122e72b8/users/9a230fe92ac24db3a086a3ec23b5049a/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:16:55.327303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe71e5a-22fa-4caa-bf00-e8f38f993822 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:55.331110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe71e5a-22fa-4caa-bf00-e8f38f993822 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:55.331110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe71e5a-22fa-4caa-bf00-e8f38f993822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:55.385372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6fe71e5a-22fa-4caa-bf00-e8f38f993822 None None] MFA Rules not processed for user `9a230fe92ac24db3a086a3ec23b5049a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:16:55.386570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6fe71e5a-22fa-4caa-bf00-e8f38f993822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:55.464122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 762/1502] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:16:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:16:55.477721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae022fa-63a0-4a5a-acd8-e90fba143199 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:55.478079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae022fa-63a0-4a5a-acd8-e90fba143199 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:55.478358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae022fa-63a0-4a5a-acd8-e90fba143199 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:55.479735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 741/1503] 10.222.0.13 () {54 vars in 964 bytes} [Wed Aug 31 11:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:16:55.485075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabb9e2-1109-4d87-b2dd-556569734609 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:55.485387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabb9e2-1109-4d87-b2dd-556569734609 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:55.485680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabb9e2-1109-4d87-b2dd-556569734609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:55.521694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:55.567034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4aabb9e2-1109-4d87-b2dd-556569734609 None None] MFA Rules not processed for user `fae0faf062ba4b7a8270fc2ff92a10be`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:16:55.568284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4aabb9e2-1109-4d87-b2dd-556569734609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:55.677544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 763/1504] 10.222.0.13 () {58 vars in 1061 bytes} [Wed Aug 31 11:16:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:16:55.687146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae022fa-63a0-4a5a-acd8-e90fba143199 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:55.688694 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fae022fa-63a0-4a5a-acd8-e90fba143199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:55.740777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:55.793442 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae022fa-63a0-4a5a-acd8-e90fba143199 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:55.870849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:55.871684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:55.871684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:55.871993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:55.873484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:55.976746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:55.978178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:55.981670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:55.995962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 742/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:16:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:16:56.046205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2848-8505-40dd-98eb-cf485f6262e7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:56.046648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2848-8505-40dd-98eb-cf485f6262e7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:56.046758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2848-8505-40dd-98eb-cf485f6262e7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:56.048041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 764/1506] 10.222.0.13 () {52 vars in 830 bytes} [Wed Aug 31 11:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:16:56.051784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:56.053258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:56.161132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81198039-277d-4709-8501-d6030be10d73 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:56.259059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:56.259722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:56.260029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:56.260296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] PATH_INFO: `/v3/users/9a230fe92ac24db3a086a3ec23b5049a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:56.273357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a230fe92ac24db3a086a3ec23b5049a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:56.274370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:16:56.274370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 31 11:16:56.274370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: Aug 31 11:16:56.275584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:56.285405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:56.424091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a230fe92ac24db3a086a3ec23b5049a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:56.438300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a230fe92ac24db3a086a3ec23b5049a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:56.461448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a230fe92ac24db3a086a3ec23b5049a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:56.461902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a230fe92ac24db3a086a3ec23b5049a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:56.462417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a230fe92ac24db3a086a3ec23b5049a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:56.532060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 743/1507] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:16:56 2022] DELETE /identity/v3/users/9a230fe92ac24db3a086a3ec23b5049a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:16:56.537319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0be85a-2828-4f0f-acb3-f16d32a52e5d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:56.537601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0be85a-2828-4f0f-acb3-f16d32a52e5d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:56.537874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0be85a-2828-4f0f-acb3-f16d32a52e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:56.628208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-de0be85a-2828-4f0f-acb3-f16d32a52e5d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:16:56.629959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-de0be85a-2828-4f0f-acb3-f16d32a52e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:56.703072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:56.715219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 765/1508] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:16:56.725787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:56.727064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:56.828387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea54853-b0d4-4f88-9153-a0d61adf1b15 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:56.884396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:16:56.903153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9752a-d56a-4add-b387-a7fd9fa3418f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:56.903792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9752a-d56a-4add-b387-a7fd9fa3418f service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:56.904075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9752a-d56a-4add-b387-a7fd9fa3418f service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:56.904347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9752a-d56a-4add-b387-a7fd9fa3418f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:56.905932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-97e9752a-d56a-4add-b387-a7fd9fa3418f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:57.014983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9752a-d56a-4add-b387-a7fd9fa3418f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:57.016375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9752a-d56a-4add-b387-a7fd9fa3418f service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:57.034162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 744/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:16:57.526471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0be85a-2828-4f0f-acb3-f16d32a52e5d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:16:57.527697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-de0be85a-2828-4f0f-acb3-f16d32a52e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:16:57.539259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0be85a-2828-4f0f-acb3-f16d32a52e5d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:16:57.638492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:16:57.639123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:16:57.639398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:16:57.639667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] PATH_INFO: `/v3/projects/c86362e975db4197bb3710e9122e72b8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:16:57.650502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86362e975db4197bb3710e9122e72b8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:16:57.651528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:16:57.651528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 31 11:16:57.651528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: Aug 31 11:16:57.652757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:16:57.781340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86362e975db4197bb3710e9122e72b8', 'request_id': 'req-bd8b64a9-662f-454e-9f02-93a2eee50309'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:57.794254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86362e975db4197bb3710e9122e72b8', 'request_id': 'req-bd8b64a9-662f-454e-9f02-93a2eee50309'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:57.800576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86362e975db4197bb3710e9122e72b8', 'request_id': 'req-bd8b64a9-662f-454e-9f02-93a2eee50309'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:57.912668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] The token cache is being invalidate because project c86362e975db4197bb3710e9122e72b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:16:57.912960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:57.913387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd8b64a9-662f-454e-9f02-93a2eee50309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:16:57.914801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 766/1510] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:16:57 2022] DELETE /identity/v3/projects/c86362e975db4197bb3710e9122e72b8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:17:07.031954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=62 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:17:07.910668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:18:34.482290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f963041-8afb-4937-9b3c-8a1577c02771 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:34.482918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f963041-8afb-4937-9b3c-8a1577c02771 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:34.482918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f963041-8afb-4937-9b3c-8a1577c02771 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:34.484325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:18:34.489803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47326c8-18b5-4444-b416-a5bb830fbda0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:34.490350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47326c8-18b5-4444-b416-a5bb830fbda0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:34.490460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47326c8-18b5-4444-b416-a5bb830fbda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:34.582867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c47326c8-18b5-4444-b416-a5bb830fbda0 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:18:34.584135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c47326c8-18b5-4444-b416-a5bb830fbda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:34.686723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:18:34.842583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f963041-8afb-4937-9b3c-8a1577c02771 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:18:34.844692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8f963041-8afb-4937-9b3c-8a1577c02771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:34.966907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f963041-8afb-4937-9b3c-8a1577c02771 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:18:34.972701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442808ef-4f84-4383-84f8-1bfff52cf55b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:18:34.973306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442808ef-4f84-4383-84f8-1bfff52cf55b service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:34.973585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442808ef-4f84-4383-84f8-1bfff52cf55b service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:34.973858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442808ef-4f84-4383-84f8-1bfff52cf55b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:34.981782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442808ef-4f84-4383-84f8-1bfff52cf55b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:18:34.983353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442808ef-4f84-4383-84f8-1bfff52cf55b service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:18:34.992463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 746/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:18:35.682931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b97d3-a490-4e2d-89d3-e2fa71df4687 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:35.683501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b97d3-a490-4e2d-89d3-e2fa71df4687 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:35.683603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b97d3-a490-4e2d-89d3-e2fa71df4687 None None] PATH_INFO: `/v3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:35.684925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 768/1514] 10.222.0.25 () {54 vars in 925 bytes} [Wed Aug 31 11:18:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:18:35.692285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906530-06f9-4726-be52-8f80ee35261e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:35.692722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906530-06f9-4726-be52-8f80ee35261e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:35.692979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906530-06f9-4726-be52-8f80ee35261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:35.753130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d1906530-06f9-4726-be52-8f80ee35261e None None] MFA Rules not processed for user `cacc0855973047b6a97e40b5f32a8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:18:35.754331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d1906530-06f9-4726-be52-8f80ee35261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:35.822065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:18:35.827214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 747/1515] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Aug 31 11:18:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:18:35.833348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af2d55-b5ea-4b81-8fb9-b966d86694e1 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:35.833632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af2d55-b5ea-4b81-8fb9-b966d86694e1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:35.834145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af2d55-b5ea-4b81-8fb9-b966d86694e1 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:35.835542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 769/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:18:35.843721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e198e46-5b2b-4b27-9700-21020394fac0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:35.843721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e198e46-5b2b-4b27-9700-21020394fac0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:35.843721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e198e46-5b2b-4b27-9700-21020394fac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:35.861451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6e198e46-5b2b-4b27-9700-21020394fac0 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:18:35.862626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6e198e46-5b2b-4b27-9700-21020394fac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:35.870398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 748/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:18:36.023797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af2d55-b5ea-4b81-8fb9-b966d86694e1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:18:36.039057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af2d55-b5ea-4b81-8fb9-b966d86694e1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:18:36.045337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45edb0-a5bd-4194-8b2e-79ff2470e6f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:18:36.045935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45edb0-a5bd-4194-8b2e-79ff2470e6f0 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:36.046215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45edb0-a5bd-4194-8b2e-79ff2470e6f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:36.046491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45edb0-a5bd-4194-8b2e-79ff2470e6f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:36.054755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45edb0-a5bd-4194-8b2e-79ff2470e6f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:18:36.056891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45edb0-a5bd-4194-8b2e-79ff2470e6f0 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:18:36.066217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 770/1518] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:18:45.279245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7129215-b2b1-44b7-b5c2-3753feea01e2 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:45.279792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7129215-b2b1-44b7-b5c2-3753feea01e2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:45.279792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7129215-b2b1-44b7-b5c2-3753feea01e2 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:45.282007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 749/1519] 10.222.0.13 () {54 vars in 961 bytes} [Wed Aug 31 11:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:18:45.286535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb839df9-5f0a-42c8-9426-35375407e6a0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:45.286982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb839df9-5f0a-42c8-9426-35375407e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:45.287089 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb839df9-5f0a-42c8-9426-35375407e6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:45.309414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-eb839df9-5f0a-42c8-9426-35375407e6a0 None None] MFA Rules not processed for user `cacc0855973047b6a97e40b5f32a8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:18:45.310597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eb839df9-5f0a-42c8-9426-35375407e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:45.319167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 771/1520] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Aug 31 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:18:45.327097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7129215-b2b1-44b7-b5c2-3753feea01e2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:18:45.340404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7129215-b2b1-44b7-b5c2-3753feea01e2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:18:45.345201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdd985-15f7-440d-8110-d7afe958411b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:18:45.345784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdd985-15f7-440d-8110-d7afe958411b service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:45.346059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdd985-15f7-440d-8110-d7afe958411b service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:45.346326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdd985-15f7-440d-8110-d7afe958411b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:45.355072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdd985-15f7-440d-8110-d7afe958411b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:18:45.356661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdd985-15f7-440d-8110-d7afe958411b service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:18:45.365954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 750/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:18:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:18:47.315674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a192-4b6c-4adb-9aaa-3be8f28e40e4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:47.316315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a192-4b6c-4adb-9aaa-3be8f28e40e4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:47.316315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a192-4b6c-4adb-9aaa-3be8f28e40e4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:47.317603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:18:47.322550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76927999-3648-4332-a621-6e2257f69e3f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:47.322974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76927999-3648-4332-a621-6e2257f69e3f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:47.323092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76927999-3648-4332-a621-6e2257f69e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:47.342733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-76927999-3648-4332-a621-6e2257f69e3f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:18:47.343989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-76927999-3648-4332-a621-6e2257f69e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:47.351796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:18:47.504541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3a192-4b6c-4adb-9aaa-3be8f28e40e4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:18:47.519160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3a192-4b6c-4adb-9aaa-3be8f28e40e4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:18:47.525441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb05c41-846a-41df-aa33-3351194fa968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:18:47.526070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb05c41-846a-41df-aa33-3351194fa968 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:47.526345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb05c41-846a-41df-aa33-3351194fa968 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:47.526612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb05c41-846a-41df-aa33-3351194fa968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:47.534778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb05c41-846a-41df-aa33-3351194fa968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:18:47.536340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb05c41-846a-41df-aa33-3351194fa968 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:18:47.545759 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 773/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:18:48.356781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616e6b8-dc23-40d1-b0cf-b93e03450820 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:48.357327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616e6b8-dc23-40d1-b0cf-b93e03450820 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:48.357327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616e6b8-dc23-40d1-b0cf-b93e03450820 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:48.358673 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 11:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:18:48.363331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b50f4-8eb8-44c7-978f-59910b0c2f08 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:48.363825 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b50f4-8eb8-44c7-978f-59910b0c2f08 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:48.363957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b50f4-8eb8-44c7-978f-59910b0c2f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:48.384049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-442b50f4-8eb8-44c7-978f-59910b0c2f08 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:18:48.385243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-442b50f4-8eb8-44c7-978f-59910b0c2f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:48.393063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 11:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:18:48.551852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616e6b8-dc23-40d1-b0cf-b93e03450820 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:18:48.566667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616e6b8-dc23-40d1-b0cf-b93e03450820 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:18:48.572296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16cb03-a7f8-454b-82ac-215e8ae7e834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:18:48.572884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16cb03-a7f8-454b-82ac-215e8ae7e834 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:48.573161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16cb03-a7f8-454b-82ac-215e8ae7e834 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:48.573429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16cb03-a7f8-454b-82ac-215e8ae7e834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:48.581486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16cb03-a7f8-454b-82ac-215e8ae7e834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:18:48.583299 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16cb03-a7f8-454b-82ac-215e8ae7e834 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:18:48.593573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 753/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:18:52.421442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb474a3a-3cca-44a2-8aa1-ec706b77c395 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:52.422019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb474a3a-3cca-44a2-8aa1-ec706b77c395 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:52.422019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb474a3a-3cca-44a2-8aa1-ec706b77c395 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:52.423395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:18:52.429225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae08cc-9b08-4669-8e4a-62e060b11e74 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:52.429779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae08cc-9b08-4669-8e4a-62e060b11e74 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:52.429779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae08cc-9b08-4669-8e4a-62e060b11e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:52.451154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d9ae08cc-9b08-4669-8e4a-62e060b11e74 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:18:52.452395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d9ae08cc-9b08-4669-8e4a-62e060b11e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:52.460180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:18:52.746664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb474a3a-3cca-44a2-8aa1-ec706b77c395 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:18:52.748410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cb474a3a-3cca-44a2-8aa1-ec706b77c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:52.781064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:18:52.826864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb474a3a-3cca-44a2-8aa1-ec706b77c395 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:18:52.830436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e48c7d-e0f4-49c3-8582-0b73061f7b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:18:52.831033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48c7d-e0f4-49c3-8582-0b73061f7b3e service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:52.831310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48c7d-e0f4-49c3-8582-0b73061f7b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:52.831580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48c7d-e0f4-49c3-8582-0b73061f7b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:52.840331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e48c7d-e0f4-49c3-8582-0b73061f7b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:18:52.841761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e48c7d-e0f4-49c3-8582-0b73061f7b3e service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:18:52.851136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 776/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:18:54.761119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0ea0b-cb82-44c5-ac42-f1a346bcc7e6 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:54.761730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0ea0b-cb82-44c5-ac42-f1a346bcc7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:54.761730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0ea0b-cb82-44c5-ac42-f1a346bcc7e6 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:54.763001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 11:18:54.768406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3d1b-e673-4a2b-ac9b-451ef6da85d9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:54.768866 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3d1b-e673-4a2b-ac9b-451ef6da85d9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:54.768969 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3d1b-e673-4a2b-ac9b-451ef6da85d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:54.788589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e2ff3d1b-e673-4a2b-ac9b-451ef6da85d9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:18:54.789769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e2ff3d1b-e673-4a2b-ac9b-451ef6da85d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:54.799296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:18:55.091006 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0ea0b-cb82-44c5-ac42-f1a346bcc7e6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:18:55.101543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0ea0b-cb82-44c5-ac42-f1a346bcc7e6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:18:55.109092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8841d65-ae7c-474d-8ca2-8b561d2fb437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:18:55.109687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8841d65-ae7c-474d-8ca2-8b561d2fb437 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:55.109960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8841d65-ae7c-474d-8ca2-8b561d2fb437 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:55.111049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8841d65-ae7c-474d-8ca2-8b561d2fb437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:55.121220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8841d65-ae7c-474d-8ca2-8b561d2fb437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:18:55.122650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8841d65-ae7c-474d-8ca2-8b561d2fb437 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:18:55.142193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 756/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:18:58.479271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c5da1-85a8-4a91-a7a6-a5a6b713d12e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:58.479876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c5da1-85a8-4a91-a7a6-a5a6b713d12e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:58.479876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c5da1-85a8-4a91-a7a6-a5a6b713d12e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:58.481564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:18:58.490239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a1ff-94c0-4be1-9439-87c52fc405cf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:58.490765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a1ff-94c0-4be1-9439-87c52fc405cf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:58.490765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a1ff-94c0-4be1-9439-87c52fc405cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:58.518059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5aa2a1ff-94c0-4be1-9439-87c52fc405cf None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:18:58.519266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5aa2a1ff-94c0-4be1-9439-87c52fc405cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:58.527609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:18:59.084474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c5da1-85a8-4a91-a7a6-a5a6b713d12e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:18:59.086121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-346c5da1-85a8-4a91-a7a6-a5a6b713d12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:18:59.170566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c5da1-85a8-4a91-a7a6-a5a6b713d12e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:18:59.176100 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4cb84-317a-42d0-9846-df4eecb81781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:18:59.177132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4cb84-317a-42d0-9846-df4eecb81781 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:18:59.177909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4cb84-317a-42d0-9846-df4eecb81781 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:18:59.178370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4cb84-317a-42d0-9846-df4eecb81781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:18:59.191045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4cb84-317a-42d0-9846-df4eecb81781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:18:59.192652 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4cb84-317a-42d0-9846-df4eecb81781 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:18:59.203622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 779/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:19:01.136213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136883b-e531-40b8-8c36-5413fc92584a None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:19:01.136796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136883b-e531-40b8-8c36-5413fc92584a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:19:01.136796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136883b-e531-40b8-8c36-5413fc92584a None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:19:01.138114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 11:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:19:01.143268 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935e01-76a3-44aa-a237-73b850a3d649 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:19:01.143696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935e01-76a3-44aa-a237-73b850a3d649 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:19:01.143840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935e01-76a3-44aa-a237-73b850a3d649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:19:01.163322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2b935e01-76a3-44aa-a237-73b850a3d649 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:19:01.164562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2b935e01-76a3-44aa-a237-73b850a3d649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:19:01.173013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:19:01.732546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136883b-e531-40b8-8c36-5413fc92584a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:19:01.734219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4136883b-e531-40b8-8c36-5413fc92584a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:19:01.747189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136883b-e531-40b8-8c36-5413fc92584a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:19:01.750873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35270f9-c59e-43b9-978b-d553902f113b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:19:01.751526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35270f9-c59e-43b9-978b-d553902f113b service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:19:01.751909 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35270f9-c59e-43b9-978b-d553902f113b service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:19:01.752187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35270f9-c59e-43b9-978b-d553902f113b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:19:01.761923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35270f9-c59e-43b9-978b-d553902f113b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:19:01.763349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35270f9-c59e-43b9-978b-d553902f113b service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:19:01.772636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 759/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:19:11.158406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=63 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:19:11.768445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=37 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:38.962368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e96b2-c94a-40de-aca0-ffab20436efa None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:38.963043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e96b2-c94a-40de-aca0-ffab20436efa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:38.963043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e96b2-c94a-40de-aca0-ffab20436efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:38.996850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7c1e96b2-c94a-40de-aca0-ffab20436efa None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:38.998202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7c1e96b2-c94a-40de-aca0-ffab20436efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.007727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 781/1540] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:20:39.017120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee05b89-1daa-4659-9338-3ffd2ac0f729 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.017702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee05b89-1daa-4659-9338-3ffd2ac0f729 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.017702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee05b89-1daa-4659-9338-3ffd2ac0f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.046269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1ee05b89-1daa-4659-9338-3ffd2ac0f729 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.047495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1ee05b89-1daa-4659-9338-3ffd2ac0f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.058936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 760/1541] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.064210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e96b2-c94a-40de-aca0-ffab20436efa None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.076632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e96b2-c94a-40de-aca0-ffab20436efa None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.085755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f80f-80da-47a0-b360-b41856f08d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.086384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f80f-80da-47a0-b360-b41856f08d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.086662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f80f-80da-47a0-b360-b41856f08d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.086933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95f80f-80da-47a0-b360-b41856f08d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.087590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f80f-80da-47a0-b360-b41856f08d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.087921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f80f-80da-47a0-b360-b41856f08d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.089537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95f80f-80da-47a0-b360-b41856f08d6a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.106862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf0247-8e6c-4223-9d88-34643f791e10 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.107218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf0247-8e6c-4223-9d88-34643f791e10 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.107428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf0247-8e6c-4223-9d88-34643f791e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.107788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 782/1542] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.115824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f80f-80da-47a0-b360-b41856f08d6a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.131149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95f80f-80da-47a0-b360-b41856f08d6a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.141322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d8cf0247-8e6c-4223-9d88-34643f791e10 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.141864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf7c03-209a-4738-95e4-f273172d10c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.142491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf7c03-209a-4738-95e4-f273172d10c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.142770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf7c03-209a-4738-95e4-f273172d10c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.142901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d8cf0247-8e6c-4223-9d88-34643f791e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.143088 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf7c03-209a-4738-95e4-f273172d10c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.143677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf7c03-209a-4738-95e4-f273172d10c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.144727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-cecf7c03-209a-4738-95e4-f273172d10c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:20:39.144727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 31 11:20:39.144727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: Aug 31 11:20:39.145935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf7c03-209a-4738-95e4-f273172d10c7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.156479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 761/1543] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:20:39.157744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e064d1-98eb-4d7f-ac90-a1cbf7d1ea79 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.158029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e064d1-98eb-4d7f-ac90-a1cbf7d1ea79 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.158303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e064d1-98eb-4d7f-ac90-a1cbf7d1ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.198648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-01e064d1-98eb-4d7f-ac90-a1cbf7d1ea79 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.199901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-01e064d1-98eb-4d7f-ac90-a1cbf7d1ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.209332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 762/1544] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.210664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7997-2253-43dc-a5b3-91bad540bed7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.218400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7997-2253-43dc-a5b3-91bad540bed7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.218400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7997-2253-43dc-a5b3-91bad540bed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.233792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-528c7997-2253-43dc-a5b3-91bad540bed7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.235008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-528c7997-2253-43dc-a5b3-91bad540bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.243397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 763/1545] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.246320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085817b-8f59-4d60-b327-698d01002980 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.246320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085817b-8f59-4d60-b327-698d01002980 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.246320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085817b-8f59-4d60-b327-698d01002980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.266139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b085817b-8f59-4d60-b327-698d01002980 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.267368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b085817b-8f59-4d60-b327-698d01002980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.275242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 764/1546] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.279796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55a10e-48be-411b-86c2-f61845a40630 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.279796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55a10e-48be-411b-86c2-f61845a40630 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.279796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55a10e-48be-411b-86c2-f61845a40630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.298744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0e55a10e-48be-411b-86c2-f61845a40630 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.299987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0e55a10e-48be-411b-86c2-f61845a40630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.308703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 765/1547] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.309890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7ce3-4a22-4c2f-a771-4a639526afc1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.310172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7ce3-4a22-4c2f-a771-4a639526afc1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.310439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7ce3-4a22-4c2f-a771-4a639526afc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.319628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 783/1548] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/projects => generated 401 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:20:39.334492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f6f4-a6fe-4c22-9020-1481343301ad None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.334492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f6f4-a6fe-4c22-9020-1481343301ad None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.334492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f6f4-a6fe-4c22-9020-1481343301ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.334802 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-463e7ce3-4a22-4c2f-a771-4a639526afc1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.334802 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-463e7ce3-4a22-4c2f-a771-4a639526afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.339915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-71e5f6f4-a6fe-4c22-9020-1481343301ad None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.341109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-71e5f6f4-a6fe-4c22-9020-1481343301ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.394594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 766/1549] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.395879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0938b-6f5b-4e94-a2c2-84c85afa272b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.396167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0938b-6f5b-4e94-a2c2-84c85afa272b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.396439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0938b-6f5b-4e94-a2c2-84c85afa272b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.408575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 784/1550] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.409939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a3183-9d68-4458-b3d8-47608959e2d6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.410225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a3183-9d68-4458-b3d8-47608959e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.410500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a3183-9d68-4458-b3d8-47608959e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.417381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-adc0938b-6f5b-4e94-a2c2-84c85afa272b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.418573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-adc0938b-6f5b-4e94-a2c2-84c85afa272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.427220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 767/1551] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.428270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0938b-6f5b-4e94-a2c2-84c85afa272b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.430427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-976a3183-9d68-4458-b3d8-47608959e2d6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.431611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-976a3183-9d68-4458-b3d8-47608959e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.439327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0938b-6f5b-4e94-a2c2-84c85afa272b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.441562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 785/1552] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.442777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd60b1-7341-4917-ad44-dd368084999d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.443180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd60b1-7341-4917-ad44-dd368084999d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.443491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd60b1-7341-4917-ad44-dd368084999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.444001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc5394-ab5b-419c-a980-a12e0931fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.444593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc5394-ab5b-419c-a980-a12e0931fa48 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.444874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc5394-ab5b-419c-a980-a12e0931fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.445148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc5394-ab5b-419c-a980-a12e0931fa48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.445789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc5394-ab5b-419c-a980-a12e0931fa48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.446093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc5394-ab5b-419c-a980-a12e0931fa48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.447094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-c1bc5394-ab5b-419c-a980-a12e0931fa48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:20:39.447094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 31 11:20:39.447094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: Aug 31 11:20:39.448000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc5394-ab5b-419c-a980-a12e0931fa48 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.460159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 768/1553] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.461354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec9938-c53e-4f18-89c0-f2905badcf6c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.461639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec9938-c53e-4f18-89c0-f2905badcf6c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.461914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec9938-c53e-4f18-89c0-f2905badcf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.462972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e9dd60b1-7341-4917-ad44-dd368084999d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.464262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e9dd60b1-7341-4917-ad44-dd368084999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.472786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 786/1554] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.476343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd60b1-7341-4917-ad44-dd368084999d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.481321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a4ec9938-c53e-4f18-89c0-f2905badcf6c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.482506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a4ec9938-c53e-4f18-89c0-f2905badcf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.486579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd60b1-7341-4917-ad44-dd368084999d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.491304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050fe09-51fb-4614-9bf4-3e5fb908261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.491452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 769/1555] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.491878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050fe09-51fb-4614-9bf4-3e5fb908261b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.492246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050fe09-51fb-4614-9bf4-3e5fb908261b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.492418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b952f-e713-4623-b8d5-b16a31745d5d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.492525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050fe09-51fb-4614-9bf4-3e5fb908261b admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.492699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b952f-e713-4623-b8d5-b16a31745d5d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.492932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b952f-e713-4623-b8d5-b16a31745d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.493132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050fe09-51fb-4614-9bf4-3e5fb908261b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.495032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050fe09-51fb-4614-9bf4-3e5fb908261b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.513005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4a9b952f-e713-4623-b8d5-b16a31745d5d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.514199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4a9b952f-e713-4623-b8d5-b16a31745d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.522085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 770/1556] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.522870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b952f-e713-4623-b8d5-b16a31745d5d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.532244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b952f-e713-4623-b8d5-b16a31745d5d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.536957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdd6b1-b461-42a1-b7db-fbee5606ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.537550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdd6b1-b461-42a1-b7db-fbee5606ab3e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.537828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdd6b1-b461-42a1-b7db-fbee5606ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.538099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdd6b1-b461-42a1-b7db-fbee5606ab3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.538741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdd6b1-b461-42a1-b7db-fbee5606ab3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.539044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdd6b1-b461-42a1-b7db-fbee5606ab3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.540666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdd6b1-b461-42a1-b7db-fbee5606ab3e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.553187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 771/1557] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.560881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69864155-61f3-41b2-8cdd-3599ec38e2c5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.560881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69864155-61f3-41b2-8cdd-3599ec38e2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.560881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69864155-61f3-41b2-8cdd-3599ec38e2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.574723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-69864155-61f3-41b2-8cdd-3599ec38e2c5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.575948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-69864155-61f3-41b2-8cdd-3599ec38e2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.578594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 787/1558] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:39.579498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050fe09-51fb-4614-9bf4-3e5fb908261b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.585407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 772/1559] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.586241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69864155-61f3-41b2-8cdd-3599ec38e2c5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.590879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050fe09-51fb-4614-9bf4-3e5fb908261b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.596568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac373ae-2c39-48d5-9114-41917c26c8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.597003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69864155-61f3-41b2-8cdd-3599ec38e2c5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.597206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac373ae-2c39-48d5-9114-41917c26c8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.597483 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac373ae-2c39-48d5-9114-41917c26c8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.597790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac373ae-2c39-48d5-9114-41917c26c8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.598431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac373ae-2c39-48d5-9114-41917c26c8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.598772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac373ae-2c39-48d5-9114-41917c26c8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.600403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac373ae-2c39-48d5-9114-41917c26c8b8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.601727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f7aa-2423-4339-9a4f-e0a7c1bdf5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.602378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f7aa-2423-4339-9a4f-e0a7c1bdf5fd admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.602657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f7aa-2423-4339-9a4f-e0a7c1bdf5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.602924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f7aa-2423-4339-9a4f-e0a7c1bdf5fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.603539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67f7aa-2423-4339-9a4f-e0a7c1bdf5fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.605469 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67f7aa-2423-4339-9a4f-e0a7c1bdf5fd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.613614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 788/1560] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.614893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cac103-eeeb-4a36-8a14-0ad3b9e29d28 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.615180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cac103-eeeb-4a36-8a14-0ad3b9e29d28 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.615453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cac103-eeeb-4a36-8a14-0ad3b9e29d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.637922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d8cac103-eeeb-4a36-8a14-0ad3b9e29d28 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:39.639110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d8cac103-eeeb-4a36-8a14-0ad3b9e29d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:39.648062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 789/1561] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:39.653552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cac103-eeeb-4a36-8a14-0ad3b9e29d28 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.659623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cac103-eeeb-4a36-8a14-0ad3b9e29d28 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.664282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc7d96-2167-44d7-85e1-12aa1cd929fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.664859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc7d96-2167-44d7-85e1-12aa1cd929fa admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.665134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc7d96-2167-44d7-85e1-12aa1cd929fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.665405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc7d96-2167-44d7-85e1-12aa1cd929fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.666042 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc7d96-2167-44d7-85e1-12aa1cd929fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.666338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc7d96-2167-44d7-85e1-12aa1cd929fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.667994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc7d96-2167-44d7-85e1-12aa1cd929fa admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.679758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 790/1562] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.687929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc7d96-2167-44d7-85e1-12aa1cd929fa admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.690847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc7d96-2167-44d7-85e1-12aa1cd929fa admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.694831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 773/1563] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:39.695496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f7aa-2423-4339-9a4f-e0a7c1bdf5fd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.695659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ab829-e757-4c9f-80f0-06db77e59a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.696290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab829-e757-4c9f-80f0-06db77e59a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.696570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab829-e757-4c9f-80f0-06db77e59a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.696846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab829-e757-4c9f-80f0-06db77e59a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.697488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ab829-e757-4c9f-80f0-06db77e59a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.697793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ab829-e757-4c9f-80f0-06db77e59a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.699435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ab829-e757-4c9f-80f0-06db77e59a8f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.713220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 791/1564] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.713851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ab829-e757-4c9f-80f0-06db77e59a8f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.723642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ab829-e757-4c9f-80f0-06db77e59a8f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.751551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.754000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:39.765806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f7aa-2423-4339-9a4f-e0a7c1bdf5fd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.770490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff760a-3f02-431d-ac5c-51f556fa082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.771099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff760a-3f02-431d-ac5c-51f556fa082c admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.771384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff760a-3f02-431d-ac5c-51f556fa082c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.771659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff760a-3f02-431d-ac5c-51f556fa082c admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.772331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff760a-3f02-431d-ac5c-51f556fa082c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.774284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff760a-3f02-431d-ac5c-51f556fa082c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.780707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ffc05-fcd3-4250-bf90-af8ab9688e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.781448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ffc05-fcd3-4250-bf90-af8ab9688e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.781727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ffc05-fcd3-4250-bf90-af8ab9688e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.782002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ffc05-fcd3-4250-bf90-af8ab9688e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.782789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ffc05-fcd3-4250-bf90-af8ab9688e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.784427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ffc05-fcd3-4250-bf90-af8ab9688e63 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.794720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 792/1565] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:39.795543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ffc05-fcd3-4250-bf90-af8ab9688e63 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.806370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ffc05-fcd3-4250-bf90-af8ab9688e63 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.811147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa570ae-006c-4929-bcb7-2a870079b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.812310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa570ae-006c-4929-bcb7-2a870079b057 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.812688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa570ae-006c-4929-bcb7-2a870079b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.812965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa570ae-006c-4929-bcb7-2a870079b057 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.813598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa570ae-006c-4929-bcb7-2a870079b057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.813895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa570ae-006c-4929-bcb7-2a870079b057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.815504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa570ae-006c-4929-bcb7-2a870079b057 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.827785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 793/1566] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.831809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa570ae-006c-4929-bcb7-2a870079b057 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.837850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa570ae-006c-4929-bcb7-2a870079b057 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.842949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c557df-09dd-4508-9c03-4017abaef22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.843610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c557df-09dd-4508-9c03-4017abaef22d admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.844008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c557df-09dd-4508-9c03-4017abaef22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.844424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c557df-09dd-4508-9c03-4017abaef22d admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.845043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c557df-09dd-4508-9c03-4017abaef22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.846922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c557df-09dd-4508-9c03-4017abaef22d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.859366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 774/1567] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/projects => generated 355 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:39.860678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff760a-3f02-431d-ac5c-51f556fa082c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.934875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff760a-3f02-431d-ac5c-51f556fa082c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.940518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406c84d-1c97-40ee-b538-a67267ac3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.941123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406c84d-1c97-40ee-b538-a67267ac3364 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.941401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406c84d-1c97-40ee-b538-a67267ac3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.941675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406c84d-1c97-40ee-b538-a67267ac3364 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.942323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406c84d-1c97-40ee-b538-a67267ac3364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:39.942625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406c84d-1c97-40ee-b538-a67267ac3364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.944329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406c84d-1c97-40ee-b538-a67267ac3364 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.956798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 775/1568] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:39.957652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406c84d-1c97-40ee-b538-a67267ac3364 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:39.966973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406c84d-1c97-40ee-b538-a67267ac3364 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:39.971915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7798d7-cd73-4fc3-8aaf-7d6be386651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:39.972500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7798d7-cd73-4fc3-8aaf-7d6be386651e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:39.972780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7798d7-cd73-4fc3-8aaf-7d6be386651e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:39.973051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7798d7-cd73-4fc3-8aaf-7d6be386651e admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:39.973729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7798d7-cd73-4fc3-8aaf-7d6be386651e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:39.975553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7798d7-cd73-4fc3-8aaf-7d6be386651e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:39.986857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 794/1569] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:39.987781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c557df-09dd-4508-9c03-4017abaef22d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.052547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c557df-09dd-4508-9c03-4017abaef22d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.057589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f047-1e5d-48e7-aa6d-eeec3c2743fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.058187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f047-1e5d-48e7-aa6d-eeec3c2743fd admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.058464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f047-1e5d-48e7-aa6d-eeec3c2743fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.058734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f047-1e5d-48e7-aa6d-eeec3c2743fd admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.059382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319f047-1e5d-48e7-aa6d-eeec3c2743fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.062077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319f047-1e5d-48e7-aa6d-eeec3c2743fd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.093293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 776/1570] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.094196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7798d7-cd73-4fc3-8aaf-7d6be386651e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.154762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7798d7-cd73-4fc3-8aaf-7d6be386651e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.159627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3aec3-3133-4d75-a236-d5394ab2cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.163338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3aec3-3133-4d75-a236-d5394ab2cfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.163338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3aec3-3133-4d75-a236-d5394ab2cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.163338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3aec3-3133-4d75-a236-d5394ab2cfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.163338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3aec3-3133-4d75-a236-d5394ab2cfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.163338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3aec3-3133-4d75-a236-d5394ab2cfc8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.317341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 777/1571] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:40 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.318185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3aec3-3133-4d75-a236-d5394ab2cfc8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.348204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.379905 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3aec3-3133-4d75-a236-d5394ab2cfc8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.386654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9411392-84e6-42ef-8204-ab3fb9492ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.387706 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9411392-84e6-42ef-8204-ab3fb9492ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.388240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9411392-84e6-42ef-8204-ab3fb9492ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.388775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9411392-84e6-42ef-8204-ab3fb9492ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.389952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9411392-84e6-42ef-8204-ab3fb9492ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.393103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9411392-84e6-42ef-8204-ab3fb9492ff1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.406962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 778/1572] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:40.407767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9411392-84e6-42ef-8204-ab3fb9492ff1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.417726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9411392-84e6-42ef-8204-ab3fb9492ff1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.423832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae9d8-1320-4c07-89ac-78208d1801d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.427632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae9d8-1320-4c07-89ac-78208d1801d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.427632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae9d8-1320-4c07-89ac-78208d1801d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.427632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae9d8-1320-4c07-89ac-78208d1801d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.427942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 795/1573] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:39 2022] POST /identity/v3/users => generated 290 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.428051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae9d8-1320-4c07-89ac-78208d1801d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.428144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f047-1e5d-48e7-aa6d-eeec3c2743fd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.428238 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae9d8-1320-4c07-89ac-78208d1801d0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.436368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f047-1e5d-48e7-aa6d-eeec3c2743fd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.441447 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc679f8-5b25-41ff-9538-cacc1094e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.442041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc679f8-5b25-41ff-9538-cacc1094e910 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.442320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc679f8-5b25-41ff-9538-cacc1094e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.442587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc679f8-5b25-41ff-9538-cacc1094e910 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.443205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc679f8-5b25-41ff-9538-cacc1094e910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.445215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc679f8-5b25-41ff-9538-cacc1094e910 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.550898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 779/1574] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:40 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.551709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae9d8-1320-4c07-89ac-78208d1801d0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.578912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 796/1575] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:40 2022] POST /identity/v3/users => generated 278 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.578912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc679f8-5b25-41ff-9538-cacc1094e910 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.588011 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc679f8-5b25-41ff-9538-cacc1094e910 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.616714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae9d8-1320-4c07-89ac-78208d1801d0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.621870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf167f1-a148-43b8-900e-45d00f3995dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.622484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf167f1-a148-43b8-900e-45d00f3995dd admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.622760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf167f1-a148-43b8-900e-45d00f3995dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.623032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf167f1-a148-43b8-900e-45d00f3995dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.623661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf167f1-a148-43b8-900e-45d00f3995dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.625665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf167f1-a148-43b8-900e-45d00f3995dd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.651921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa64c0-10f6-4f00-b81b-8233caedba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.655189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa64c0-10f6-4f00-b81b-8233caedba25 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.655189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa64c0-10f6-4f00-b81b-8233caedba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.655189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa64c0-10f6-4f00-b81b-8233caedba25 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.655189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa64c0-10f6-4f00-b81b-8233caedba25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.656415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa64c0-10f6-4f00-b81b-8233caedba25 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.667538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.716527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 780/1576] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:40 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.717522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf167f1-a148-43b8-900e-45d00f3995dd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.750729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 797/1577] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:40 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.758820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa64c0-10f6-4f00-b81b-8233caedba25 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.761267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa64c0-10f6-4f00-b81b-8233caedba25 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.787343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf167f1-a148-43b8-900e-45d00f3995dd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.792151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219591cd-ca6e-4d27-8700-bbe4b783971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.792761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219591cd-ca6e-4d27-8700-bbe4b783971e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.793045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219591cd-ca6e-4d27-8700-bbe4b783971e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.793357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219591cd-ca6e-4d27-8700-bbe4b783971e admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.793986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219591cd-ca6e-4d27-8700-bbe4b783971e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.794993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-219591cd-ca6e-4d27-8700-bbe4b783971e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:20:40.794993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 31 11:20:40.794993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: Aug 31 11:20:40.796244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219591cd-ca6e-4d27-8700-bbe4b783971e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.822835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec77ff-c898-4949-92c8-d4b593d4240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.823446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec77ff-c898-4949-92c8-d4b593d4240e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.823720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec77ff-c898-4949-92c8-d4b593d4240e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.824024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec77ff-c898-4949-92c8-d4b593d4240e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.824682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec77ff-c898-4949-92c8-d4b593d4240e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.826602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec77ff-c898-4949-92c8-d4b593d4240e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.878390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 781/1578] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:40 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.878390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219591cd-ca6e-4d27-8700-bbe4b783971e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.885870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219591cd-ca6e-4d27-8700-bbe4b783971e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.891132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1274f1-5ff4-41db-bd31-5727027eb1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.891788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1274f1-5ff4-41db-bd31-5727027eb1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.892067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1274f1-5ff4-41db-bd31-5727027eb1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.892334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1274f1-5ff4-41db-bd31-5727027eb1fd admin admin] PATH_INFO: `/v3/projects/bc1929c3f8424efda20739cdb2723788/users/271b9abc31904f949cfd769db8681e42/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.908123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1274f1-5ff4-41db-bd31-5727027eb1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1929c3f8424efda20739cdb2723788, user_id=271b9abc31904f949cfd769db8681e42, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.913255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1274f1-5ff4-41db-bd31-5727027eb1fd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.913255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:40.938785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 798/1579] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:40 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:40.941846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec77ff-c898-4949-92c8-d4b593d4240e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.950474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec77ff-c898-4949-92c8-d4b593d4240e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.955714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad05d1-c91b-4bb8-95fb-2e98942d16fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.956329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad05d1-c91b-4bb8-95fb-2e98942d16fc admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.956602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad05d1-c91b-4bb8-95fb-2e98942d16fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.956870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad05d1-c91b-4bb8-95fb-2e98942d16fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.957505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad05d1-c91b-4bb8-95fb-2e98942d16fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.959097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad05d1-c91b-4bb8-95fb-2e98942d16fc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:40.970264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 799/1580] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:40.971153 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad05d1-c91b-4bb8-95fb-2e98942d16fc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:40.980458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad05d1-c91b-4bb8-95fb-2e98942d16fc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:40.985331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13753d25-474a-4821-b265-293a5791e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:40.985890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13753d25-474a-4821-b265-293a5791e486 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:40.993306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13753d25-474a-4821-b265-293a5791e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:40.993306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13753d25-474a-4821-b265-293a5791e486 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:40.993306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13753d25-474a-4821-b265-293a5791e486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:40.993306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13753d25-474a-4821-b265-293a5791e486 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.041253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 782/1581] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:40 2022] PUT /identity/v3/projects/bc1929c3f8424efda20739cdb2723788/users/271b9abc31904f949cfd769db8681e42/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:41.042175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1274f1-5ff4-41db-bd31-5727027eb1fd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.099304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 800/1582] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:40 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:41.100280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13753d25-474a-4821-b265-293a5791e486 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.105998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1274f1-5ff4-41db-bd31-5727027eb1fd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.110350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13753d25-474a-4821-b265-293a5791e486 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.110737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1dfd5-234f-44d3-8eb4-fcfd2bd1d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.111344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1dfd5-234f-44d3-8eb4-fcfd2bd1d4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.111621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1dfd5-234f-44d3-8eb4-fcfd2bd1d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.111939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1dfd5-234f-44d3-8eb4-fcfd2bd1d4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.112588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1dfd5-234f-44d3-8eb4-fcfd2bd1d4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.114176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1dfd5-234f-44d3-8eb4-fcfd2bd1d4e1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.115134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5719-6f4e-49a5-b1f9-99ed811ea2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.115723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5719-6f4e-49a5-b1f9-99ed811ea2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.116029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5719-6f4e-49a5-b1f9-99ed811ea2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.116310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5719-6f4e-49a5-b1f9-99ed811ea2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.116935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5719-6f4e-49a5-b1f9-99ed811ea2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.118906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5719-6f4e-49a5-b1f9-99ed811ea2f9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.128259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 783/1583] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.128259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1dfd5-234f-44d3-8eb4-fcfd2bd1d4e1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.137908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1dfd5-234f-44d3-8eb4-fcfd2bd1d4e1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.143194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069e87-9f5f-472b-8f7d-f2c1c783bb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.143907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069e87-9f5f-472b-8f7d-f2c1c783bb1c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.144174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069e87-9f5f-472b-8f7d-f2c1c783bb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.144325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069e87-9f5f-472b-8f7d-f2c1c783bb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.144952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069e87-9f5f-472b-8f7d-f2c1c783bb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.146527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069e87-9f5f-472b-8f7d-f2c1c783bb1c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.157249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 784/1584] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.158139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069e87-9f5f-472b-8f7d-f2c1c783bb1c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.167399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069e87-9f5f-472b-8f7d-f2c1c783bb1c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.172595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fd94c-919c-4c0f-92b8-d02de6ec38fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.172750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fd94c-919c-4c0f-92b8-d02de6ec38fc admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.173031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fd94c-919c-4c0f-92b8-d02de6ec38fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.173303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fd94c-919c-4c0f-92b8-d02de6ec38fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.173916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fd94c-919c-4c0f-92b8-d02de6ec38fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.175456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fd94c-919c-4c0f-92b8-d02de6ec38fc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.185928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 785/1585] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.186679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fd94c-919c-4c0f-92b8-d02de6ec38fc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.196832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fd94c-919c-4c0f-92b8-d02de6ec38fc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.204211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 801/1586] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:41 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:41.204365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcca051-4d09-476b-9e5b-c40d5b20d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.204481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5719-6f4e-49a5-b1f9-99ed811ea2f9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.204590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcca051-4d09-476b-9e5b-c40d5b20d485 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.204590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcca051-4d09-476b-9e5b-c40d5b20d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.204590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcca051-4d09-476b-9e5b-c40d5b20d485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.204590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcca051-4d09-476b-9e5b-c40d5b20d485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.205560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcca051-4d09-476b-9e5b-c40d5b20d485 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.212298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5719-6f4e-49a5-b1f9-99ed811ea2f9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.215962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 786/1587] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.216926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f917ff1-6dd4-4af7-bc8c-efc3edfe5fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.221427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1d919-de72-4697-b126-a38221463cb1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.221544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f917ff1-6dd4-4af7-bc8c-efc3edfe5fac admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.221643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1d919-de72-4697-b126-a38221463cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.221733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f917ff1-6dd4-4af7-bc8c-efc3edfe5fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.221810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1d919-de72-4697-b126-a38221463cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.221912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f917ff1-6dd4-4af7-bc8c-efc3edfe5fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.221912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f917ff1-6dd4-4af7-bc8c-efc3edfe5fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.221912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f917ff1-6dd4-4af7-bc8c-efc3edfe5fac admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.232744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 802/1588] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.233412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f917ff1-6dd4-4af7-bc8c-efc3edfe5fac admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.242889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f917ff1-6dd4-4af7-bc8c-efc3edfe5fac admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.247541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc0f62-683e-4c6a-bebe-e3ef88dd0fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.248162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc0f62-683e-4c6a-bebe-e3ef88dd0fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.248431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc0f62-683e-4c6a-bebe-e3ef88dd0fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.248699 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc0f62-683e-4c6a-bebe-e3ef88dd0fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.249336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc0f62-683e-4c6a-bebe-e3ef88dd0fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.251499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc0f62-683e-4c6a-bebe-e3ef88dd0fb4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.255505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-88a1d919-de72-4697-b126-a38221463cb1 None None] MFA Rules not processed for user `271b9abc31904f949cfd769db8681e42`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:41.256753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-88a1d919-de72-4697-b126-a38221463cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:41.261618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 803/1589] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.262474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc0f62-683e-4c6a-bebe-e3ef88dd0fb4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.272477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc0f62-683e-4c6a-bebe-e3ef88dd0fb4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.277014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d5b1d-4cf9-4d5c-a91c-8319b5d65587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.277645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d5b1d-4cf9-4d5c-a91c-8319b5d65587 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.277884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d5b1d-4cf9-4d5c-a91c-8319b5d65587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.278149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d5b1d-4cf9-4d5c-a91c-8319b5d65587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.278773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d5b1d-4cf9-4d5c-a91c-8319b5d65587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.280398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d5b1d-4cf9-4d5c-a91c-8319b5d65587 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.290953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 804/1590] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.291769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d5b1d-4cf9-4d5c-a91c-8319b5d65587 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.301238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d5b1d-4cf9-4d5c-a91c-8319b5d65587 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.306649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a066f0f-8a87-4729-bb68-0f3aec266c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.307235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a066f0f-8a87-4729-bb68-0f3aec266c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.307514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a066f0f-8a87-4729-bb68-0f3aec266c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.307819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a066f0f-8a87-4729-bb68-0f3aec266c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.308453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a066f0f-8a87-4729-bb68-0f3aec266c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.310058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a066f0f-8a87-4729-bb68-0f3aec266c61 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.321276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 805/1591] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.321910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a066f0f-8a87-4729-bb68-0f3aec266c61 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.331825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 787/1592] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:41.333002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1d919-de72-4697-b126-a38221463cb1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.334216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a066f0f-8a87-4729-bb68-0f3aec266c61 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.338797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f8b7d-e495-452d-8188-6d255500386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.339375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f8b7d-e495-452d-8188-6d255500386d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.339671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f8b7d-e495-452d-8188-6d255500386d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.339947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f8b7d-e495-452d-8188-6d255500386d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.340584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f8b7d-e495-452d-8188-6d255500386d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.342165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f8b7d-e495-452d-8188-6d255500386d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.344882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1d919-de72-4697-b126-a38221463cb1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.350133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2de8f-1892-49d3-82a8-e1028eba9680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.350673 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2de8f-1892-49d3-82a8-e1028eba9680 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.350955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2de8f-1892-49d3-82a8-e1028eba9680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.351228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2de8f-1892-49d3-82a8-e1028eba9680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.351901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2de8f-1892-49d3-82a8-e1028eba9680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.352440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 806/1593] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.353241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f8b7d-e495-452d-8188-6d255500386d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.353488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2de8f-1892-49d3-82a8-e1028eba9680 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.367008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 788/1594] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.367186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f8b7d-e495-452d-8188-6d255500386d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.367275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2de8f-1892-49d3-82a8-e1028eba9680 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.369522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5f526-28a6-4c8d-8644-b53239fd966a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.370130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5f526-28a6-4c8d-8644-b53239fd966a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.370386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5f526-28a6-4c8d-8644-b53239fd966a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.370658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5f526-28a6-4c8d-8644-b53239fd966a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.371287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5f526-28a6-4c8d-8644-b53239fd966a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.372902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5f526-28a6-4c8d-8644-b53239fd966a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.375187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2de8f-1892-49d3-82a8-e1028eba9680 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.379902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dbabc-7b49-434b-ba4f-1d0ce24b2e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.380538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dbabc-7b49-434b-ba4f-1d0ce24b2e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.380819 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dbabc-7b49-434b-ba4f-1d0ce24b2e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.381092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dbabc-7b49-434b-ba4f-1d0ce24b2e1c admin admin] PATH_INFO: `/v3/projects/90a58afe4f5f4636b410cd0791a7968c/users/f83da62462fb4dc5aff180756de3d12f/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.386310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 807/1595] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.386310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5f526-28a6-4c8d-8644-b53239fd966a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.394134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5f526-28a6-4c8d-8644-b53239fd966a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.398743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eb3d9-05bb-4b7f-8031-65a3186f9cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.399326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eb3d9-05bb-4b7f-8031-65a3186f9cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.399605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eb3d9-05bb-4b7f-8031-65a3186f9cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.399907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eb3d9-05bb-4b7f-8031-65a3186f9cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.400076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dbabc-7b49-434b-ba4f-1d0ce24b2e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a58afe4f5f4636b410cd0791a7968c, user_id=f83da62462fb4dc5aff180756de3d12f, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.400535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5eb3d9-05bb-4b7f-8031-65a3186f9cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.402107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5eb3d9-05bb-4b7f-8031-65a3186f9cf6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.402721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dbabc-7b49-434b-ba4f-1d0ce24b2e1c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.413026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 808/1596] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.419729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eb3d9-05bb-4b7f-8031-65a3186f9cf6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.423539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eb3d9-05bb-4b7f-8031-65a3186f9cf6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.428329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0d380-e427-430f-bd79-4069db0d11eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.429253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d380-e427-430f-bd79-4069db0d11eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.429530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d380-e427-430f-bd79-4069db0d11eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.429798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d380-e427-430f-bd79-4069db0d11eb admin admin] PATH_INFO: `/v3/projects/d0a8213c70ca4a49bc78ff63e1a99634/users/642fb00f2ea243cbbe2c11f2c78a785a/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.445576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0d380-e427-430f-bd79-4069db0d11eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a8213c70ca4a49bc78ff63e1a99634, user_id=642fb00f2ea243cbbe2c11f2c78a785a, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.447316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-36c0d380-e427-430f-bd79-4069db0d11eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:20:41.447316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 31 11:20:41.447316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: Aug 31 11:20:41.448566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0d380-e427-430f-bd79-4069db0d11eb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.469613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 789/1597] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:41 2022] PUT /identity/v3/projects/90a58afe4f5f4636b410cd0791a7968c/users/f83da62462fb4dc5aff180756de3d12f/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:41.476036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dbabc-7b49-434b-ba4f-1d0ce24b2e1c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.483000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:41.531373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dbabc-7b49-434b-ba4f-1d0ce24b2e1c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.536000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94cfc6-41ac-4d13-8e94-37061b04e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.536653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94cfc6-41ac-4d13-8e94-37061b04e8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.536928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94cfc6-41ac-4d13-8e94-37061b04e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.537200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94cfc6-41ac-4d13-8e94-37061b04e8a8 admin admin] PATH_INFO: `/v3/projects/6322bdbef417485c81287e9238a1c751/users/713abcb6fbc1425a83aa794243ea93d5/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.538678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:41.544625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 809/1598] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:41 2022] PUT /identity/v3/projects/d0a8213c70ca4a49bc78ff63e1a99634/users/642fb00f2ea243cbbe2c11f2c78a785a/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:41.545387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0d380-e427-430f-bd79-4069db0d11eb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.560405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94cfc6-41ac-4d13-8e94-37061b04e8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6322bdbef417485c81287e9238a1c751, user_id=713abcb6fbc1425a83aa794243ea93d5, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.564265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94cfc6-41ac-4d13-8e94-37061b04e8a8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.606900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0d380-e427-430f-bd79-4069db0d11eb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.612118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604691b-59ba-4799-b778-3136ab5774f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.612715 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604691b-59ba-4799-b778-3136ab5774f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.612986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604691b-59ba-4799-b778-3136ab5774f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.613251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604691b-59ba-4799-b778-3136ab5774f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.614023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604691b-59ba-4799-b778-3136ab5774f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.615927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604691b-59ba-4799-b778-3136ab5774f1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.652223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 790/1599] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:41 2022] PUT /identity/v3/projects/6322bdbef417485c81287e9238a1c751/users/713abcb6fbc1425a83aa794243ea93d5/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:41.654212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94cfc6-41ac-4d13-8e94-37061b04e8a8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.717554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94cfc6-41ac-4d13-8e94-37061b04e8a8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.722298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1acef-a336-4444-98fd-462d96f3ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.722948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1acef-a336-4444-98fd-462d96f3ce5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.723228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1acef-a336-4444-98fd-462d96f3ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.723616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1acef-a336-4444-98fd-462d96f3ce5a admin admin] PATH_INFO: `/v3/projects/5c412abfa55544f1be0ceb414b6415b2/users/f98fad9667be4472a4dd7e9101daebf2/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.734607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 810/1600] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:41 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:41.735583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604691b-59ba-4799-b778-3136ab5774f1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.739689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1acef-a336-4444-98fd-462d96f3ce5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c412abfa55544f1be0ceb414b6415b2, user_id=f98fad9667be4472a4dd7e9101daebf2, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.742426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1acef-a336-4444-98fd-462d96f3ce5a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.795700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 791/1601] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:41 2022] PUT /identity/v3/projects/5c412abfa55544f1be0ceb414b6415b2/users/f98fad9667be4472a4dd7e9101daebf2/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:41.797202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604691b-59ba-4799-b778-3136ab5774f1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.797440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1acef-a336-4444-98fd-462d96f3ce5a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.856330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ad91f-b9f7-4b2c-9e1a-efb77a091c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.856991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ad91f-b9f7-4b2c-9e1a-efb77a091c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.857209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ad91f-b9f7-4b2c-9e1a-efb77a091c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.857476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ad91f-b9f7-4b2c-9e1a-efb77a091c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.858111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ad91f-b9f7-4b2c-9e1a-efb77a091c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.860450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ad91f-b9f7-4b2c-9e1a-efb77a091c64 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.864499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1acef-a336-4444-98fd-462d96f3ce5a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.869207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf321-2173-42bf-aa6c-d3478a8a57c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.869857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf321-2173-42bf-aa6c-d3478a8a57c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.870134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf321-2173-42bf-aa6c-d3478a8a57c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.870281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 811/1602] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:41.870405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf321-2173-42bf-aa6c-d3478a8a57c1 admin admin] PATH_INFO: `/v3/projects/991d68dded534f27ad5d92430f2ba147/users/9078f78d2be04e63a4a0d5288263fe3d/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.872582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ad91f-b9f7-4b2c-9e1a-efb77a091c64 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:41.883544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ad91f-b9f7-4b2c-9e1a-efb77a091c64 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:41.886564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcf321-2173-42bf-aa6c-d3478a8a57c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991d68dded534f27ad5d92430f2ba147, user_id=9078f78d2be04e63a4a0d5288263fe3d, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.888405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef317174-90ac-4a6d-8c42-8b9a296e731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:41.889048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef317174-90ac-4a6d-8c42-8b9a296e731a admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.889310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfcf321-2173-42bf-aa6c-d3478a8a57c1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.889416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef317174-90ac-4a6d-8c42-8b9a296e731a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.889589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef317174-90ac-4a6d-8c42-8b9a296e731a admin admin] PATH_INFO: `/v3/projects/41c9b8d7c4f64c4c8f0d0724905a5041/users/dbf1e2002b3b474f8af0d2e5efecb412/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.904626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef317174-90ac-4a6d-8c42-8b9a296e731a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c9b8d7c4f64c4c8f0d0724905a5041, user_id=dbf1e2002b3b474f8af0d2e5efecb412, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:41.908310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef317174-90ac-4a6d-8c42-8b9a296e731a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:41.939965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:41.944923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 792/1603] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:41 2022] PUT /identity/v3/projects/991d68dded534f27ad5d92430f2ba147/users/9078f78d2be04e63a4a0d5288263fe3d/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:41.946314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829d3b3-aacf-4660-9652-d8f781e224ab None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.946687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829d3b3-aacf-4660-9652-d8f781e224ab None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.946980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829d3b3-aacf-4660-9652-d8f781e224ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.962456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 812/1604] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:41 2022] PUT /identity/v3/projects/41c9b8d7c4f64c4c8f0d0724905a5041/users/dbf1e2002b3b474f8af0d2e5efecb412/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:41.964048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed659ce-effa-4c6e-81c0-3d449596214c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:41.964329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed659ce-effa-4c6e-81c0-3d449596214c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:41.964599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed659ce-effa-4c6e-81c0-3d449596214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:41.971496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0829d3b3-aacf-4660-9652-d8f781e224ab None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:41.972107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:41.974544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0829d3b3-aacf-4660-9652-d8f781e224ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:41.994774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-eed659ce-effa-4c6e-81c0-3d449596214c None None] MFA Rules not processed for user `642fb00f2ea243cbbe2c11f2c78a785a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:41.996006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eed659ce-effa-4c6e-81c0-3d449596214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:42.036670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 793/1605] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:42.038222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7cae-74d1-4f8e-a8fd-0ac0b5c0daa7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.038505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7cae-74d1-4f8e-a8fd-0ac0b5c0daa7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.038781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7cae-74d1-4f8e-a8fd-0ac0b5c0daa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.060054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-fc0f7cae-74d1-4f8e-a8fd-0ac0b5c0daa7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:42.061260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fc0f7cae-74d1-4f8e-a8fd-0ac0b5c0daa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:42.068457 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 813/1606] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:42.069272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed659ce-effa-4c6e-81c0-3d449596214c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.069386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 794/1607] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:42.073864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66effb97-bef4-427b-9c57-6bcd04cb8ccf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.074155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66effb97-bef4-427b-9c57-6bcd04cb8ccf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.074434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66effb97-bef4-427b-9c57-6bcd04cb8ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.079870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed659ce-effa-4c6e-81c0-3d449596214c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.084689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eef268-da15-478d-ab8c-b3f2e7c20458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.085291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eef268-da15-478d-ab8c-b3f2e7c20458 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.085562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eef268-da15-478d-ab8c-b3f2e7c20458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.085828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eef268-da15-478d-ab8c-b3f2e7c20458 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.086449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eef268-da15-478d-ab8c-b3f2e7c20458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.088413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eef268-da15-478d-ab8c-b3f2e7c20458 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.103041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-66effb97-bef4-427b-9c57-6bcd04cb8ccf None None] MFA Rules not processed for user `f98fad9667be4472a4dd7e9101daebf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:42.104288 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-66effb97-bef4-427b-9c57-6bcd04cb8ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:42.169847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 795/1608] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:42.172805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 814/1609] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:42.174046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66effb97-bef4-427b-9c57-6bcd04cb8ccf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.174172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119e6a-67b8-4300-8313-b5917a97e38b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.174376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119e6a-67b8-4300-8313-b5917a97e38b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.174717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119e6a-67b8-4300-8313-b5917a97e38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.186247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66effb97-bef4-427b-9c57-6bcd04cb8ccf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.191525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb5c63-adfc-416f-b11c-9623ade184eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.192221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb5c63-adfc-416f-b11c-9623ade184eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.192496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb5c63-adfc-416f-b11c-9623ade184eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.192829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb5c63-adfc-416f-b11c-9623ade184eb admin admin] PATH_INFO: `/v3/projects/433b9b3142de4914b519daa26b669b36/users/96621bb1277a46c09ec8357dff724766/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.204795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-87119e6a-67b8-4300-8313-b5917a97e38b None None] MFA Rules not processed for user `9078f78d2be04e63a4a0d5288263fe3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:42.206023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-87119e6a-67b8-4300-8313-b5917a97e38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:42.208301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb5c63-adfc-416f-b11c-9623ade184eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=433b9b3142de4914b519daa26b669b36, user_id=96621bb1277a46c09ec8357dff724766, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.210953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb5c63-adfc-416f-b11c-9623ade184eb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.271352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 815/1610] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:42.272793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7986d-1fe5-43a4-bf1e-b1f0991bb74d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.273078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7986d-1fe5-43a4-bf1e-b1f0991bb74d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.273369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7986d-1fe5-43a4-bf1e-b1f0991bb74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.304315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-39d7986d-1fe5-43a4-bf1e-b1f0991bb74d None None] MFA Rules not processed for user `dbf1e2002b3b474f8af0d2e5efecb412`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:42.305695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-39d7986d-1fe5-43a4-bf1e-b1f0991bb74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:42.306139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 796/1611] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:42 2022] PUT /identity/v3/projects/433b9b3142de4914b519daa26b669b36/users/96621bb1277a46c09ec8357dff724766/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:42.319386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb5c63-adfc-416f-b11c-9623ade184eb admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.366938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:42.376784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 816/1612] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:42.376955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb5c63-adfc-416f-b11c-9623ade184eb admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.377919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7986d-1fe5-43a4-bf1e-b1f0991bb74d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.380577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3a542-bbcf-4442-b5a8-3f9302e8eaec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.381172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3a542-bbcf-4442-b5a8-3f9302e8eaec service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.381458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3a542-bbcf-4442-b5a8-3f9302e8eaec service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.381732 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3a542-bbcf-4442-b5a8-3f9302e8eaec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.397944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:42.448198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7986d-1fe5-43a4-bf1e-b1f0991bb74d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.450833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3a542-bbcf-4442-b5a8-3f9302e8eaec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.452302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3a542-bbcf-4442-b5a8-3f9302e8eaec service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.452715 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680239a-4452-4baa-a84c-b481299e5718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.453503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680239a-4452-4baa-a84c-b481299e5718 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.453776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680239a-4452-4baa-a84c-b481299e5718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.454044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680239a-4452-4baa-a84c-b481299e5718 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.454668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680239a-4452-4baa-a84c-b481299e5718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.456901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680239a-4452-4baa-a84c-b481299e5718 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.462155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 797/1613] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:42.463151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3a542-bbcf-4442-b5a8-3f9302e8eaec service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.471096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3a542-bbcf-4442-b5a8-3f9302e8eaec service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.476018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9f48d-c694-4032-9ef0-9a06a6640281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.476732 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9f48d-c694-4032-9ef0-9a06a6640281 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.477087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9f48d-c694-4032-9ef0-9a06a6640281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.477454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9f48d-c694-4032-9ef0-9a06a6640281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.488155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9f48d-c694-4032-9ef0-9a06a6640281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.489585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9f48d-c694-4032-9ef0-9a06a6640281 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.498980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 798/1614] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:42.500315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9f48d-c694-4032-9ef0-9a06a6640281 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.509066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9f48d-c694-4032-9ef0-9a06a6640281 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.513959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c2a55-651e-4ce3-b454-fcdca5f40930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.514620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2a55-651e-4ce3-b454-fcdca5f40930 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.514989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2a55-651e-4ce3-b454-fcdca5f40930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.515525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2a55-651e-4ce3-b454-fcdca5f40930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.516436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c2a55-651e-4ce3-b454-fcdca5f40930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.518420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c2a55-651e-4ce3-b454-fcdca5f40930 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.556533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 817/1615] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/projects => generated 357 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:42.557381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680239a-4452-4baa-a84c-b481299e5718 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.620429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 799/1616] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:42.621876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8a21-deb2-436b-91dd-d921d3691615 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.622099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8a21-deb2-436b-91dd-d921d3691615 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.622376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a8a21-deb2-436b-91dd-d921d3691615 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.624064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 800/1617] 10.222.0.13 () {54 vars in 962 bytes} [Wed Aug 31 11:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:42.625397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680239a-4452-4baa-a84c-b481299e5718 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.625889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80e55-1d51-47d1-9b0d-41ce2cf77b1e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.626307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80e55-1d51-47d1-9b0d-41ce2cf77b1e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.626650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80e55-1d51-47d1-9b0d-41ce2cf77b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.658129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-84a80e55-1d51-47d1-9b0d-41ce2cf77b1e None None] MFA Rules not processed for user `96621bb1277a46c09ec8357dff724766`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:42.659527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-84a80e55-1d51-47d1-9b0d-41ce2cf77b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:42.692382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d872f38-a423-4742-b63f-01fdbcb7f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.693004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d872f38-a423-4742-b63f-01fdbcb7f067 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.693280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d872f38-a423-4742-b63f-01fdbcb7f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.693550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d872f38-a423-4742-b63f-01fdbcb7f067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.694249 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d872f38-a423-4742-b63f-01fdbcb7f067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.696024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d872f38-a423-4742-b63f-01fdbcb7f067 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.712012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 818/1618] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:42.716482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a062a-972f-4ddd-869d-4d1d59147530 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.717390 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a062a-972f-4ddd-869d-4d1d59147530 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.717671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a062a-972f-4ddd-869d-4d1d59147530 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.720051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 819/1619] 10.222.0.13 () {54 vars in 962 bytes} [Wed Aug 31 11:20:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:42.725044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a062a-972f-4ddd-869d-4d1d59147530 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.738396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a062a-972f-4ddd-869d-4d1d59147530 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.746280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 801/1620] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:42.746445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b184-e107-4e6b-9725-f5dfe9bf5ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.746445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b184-e107-4e6b-9725-f5dfe9bf5ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.746670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a80e55-1d51-47d1-9b0d-41ce2cf77b1e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.746775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b184-e107-4e6b-9725-f5dfe9bf5ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.746775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b184-e107-4e6b-9725-f5dfe9bf5ccb admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.746775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b184-e107-4e6b-9725-f5dfe9bf5ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.746775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b184-e107-4e6b-9725-f5dfe9bf5ccb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.757935 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a80e55-1d51-47d1-9b0d-41ce2cf77b1e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.762638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092941c-376c-4f4b-b53c-ce9e6da15c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.763233 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092941c-376c-4f4b-b53c-ce9e6da15c80 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.763509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092941c-376c-4f4b-b53c-ce9e6da15c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.763829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092941c-376c-4f4b-b53c-ce9e6da15c80 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.764535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092941c-376c-4f4b-b53c-ce9e6da15c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.767040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092941c-376c-4f4b-b53c-ce9e6da15c80 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.824410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 820/1621] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:42.824410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39793d-3951-4b03-aea2-6f1c1459cacc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.824410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39793d-3951-4b03-aea2-6f1c1459cacc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.824410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39793d-3951-4b03-aea2-6f1c1459cacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.831986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:42.864678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4c39793d-3951-4b03-aea2-6f1c1459cacc None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:42.865246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 802/1622] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:42.865957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4c39793d-3951-4b03-aea2-6f1c1459cacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:42.866130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092941c-376c-4f4b-b53c-ce9e6da15c80 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.893262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092941c-376c-4f4b-b53c-ce9e6da15c80 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:42.893262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de882-cd74-4f10-baf6-1b7c44e49211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:42.893262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de882-cd74-4f10-baf6-1b7c44e49211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.893262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de882-cd74-4f10-baf6-1b7c44e49211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.893711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de882-cd74-4f10-baf6-1b7c44e49211 admin admin] PATH_INFO: `/v3/projects/6c472f9397604d17a397056103214c5c/users/54696bf723894963891d361acc48eda9/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.900458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17de882-cd74-4f10-baf6-1b7c44e49211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c472f9397604d17a397056103214c5c, user_id=54696bf723894963891d361acc48eda9, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:42.903251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17de882-cd74-4f10-baf6-1b7c44e49211 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:42.944481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 821/1623] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:42.945969 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead652e5-63ff-4327-8de7-4a9b85c55193 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:42.946331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead652e5-63ff-4327-8de7-4a9b85c55193 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:42.946965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead652e5-63ff-4327-8de7-4a9b85c55193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:42.967908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ead652e5-63ff-4327-8de7-4a9b85c55193 None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:42.970149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ead652e5-63ff-4327-8de7-4a9b85c55193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:42.980977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 822/1624] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:42.982212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead652e5-63ff-4327-8de7-4a9b85c55193 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:42.995120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead652e5-63ff-4327-8de7-4a9b85c55193 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.001391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 803/1625] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:42 2022] PUT /identity/v3/projects/6c472f9397604d17a397056103214c5c/users/54696bf723894963891d361acc48eda9/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:43.009512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de882-cd74-4f10-baf6-1b7c44e49211 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.040062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:43.063994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d5fc2-8081-4230-a9de-cc13ab306e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.064682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d5fc2-8081-4230-a9de-cc13ab306e2a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.066659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d5fc2-8081-4230-a9de-cc13ab306e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.066659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d5fc2-8081-4230-a9de-cc13ab306e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.066659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d5fc2-8081-4230-a9de-cc13ab306e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.067885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d5fc2-8081-4230-a9de-cc13ab306e2a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.082508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de882-cd74-4f10-baf6-1b7c44e49211 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.088954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56adb60-aa1a-46c5-a573-c12cd3d643e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.089561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56adb60-aa1a-46c5-a573-c12cd3d643e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.089891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56adb60-aa1a-46c5-a573-c12cd3d643e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.090130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56adb60-aa1a-46c5-a573-c12cd3d643e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.090773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56adb60-aa1a-46c5-a573-c12cd3d643e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.092419 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56adb60-aa1a-46c5-a573-c12cd3d643e0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.103656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 804/1626] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:43.104501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56adb60-aa1a-46c5-a573-c12cd3d643e0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.114344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56adb60-aa1a-46c5-a573-c12cd3d643e0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.119001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0cfd3-1b44-46cb-9d25-83602c9b6635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.119546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0cfd3-1b44-46cb-9d25-83602c9b6635 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.119869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0cfd3-1b44-46cb-9d25-83602c9b6635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.120141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0cfd3-1b44-46cb-9d25-83602c9b6635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.124074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0cfd3-1b44-46cb-9d25-83602c9b6635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.124074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0cfd3-1b44-46cb-9d25-83602c9b6635 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.133436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 805/1627] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:43.134366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0cfd3-1b44-46cb-9d25-83602c9b6635 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.214942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 823/1628] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:42 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:43.218406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d5fc2-8081-4230-a9de-cc13ab306e2a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.232781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0cfd3-1b44-46cb-9d25-83602c9b6635 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.313155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:43.328376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d5fc2-8081-4230-a9de-cc13ab306e2a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.330907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600197ae-ef7d-41f4-b686-f2d50af7d245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.331564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600197ae-ef7d-41f4-b686-f2d50af7d245 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.331881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600197ae-ef7d-41f4-b686-f2d50af7d245 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.332208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600197ae-ef7d-41f4-b686-f2d50af7d245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.335430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9aabb9-1408-4f82-b3f2-deb73c585cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.336077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9aabb9-1408-4f82-b3f2-deb73c585cc6 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.336350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9aabb9-1408-4f82-b3f2-deb73c585cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.336618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9aabb9-1408-4f82-b3f2-deb73c585cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.383987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:43.413218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600197ae-ef7d-41f4-b686-f2d50af7d245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.415290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600197ae-ef7d-41f4-b686-f2d50af7d245 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.416258 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9aabb9-1408-4f82-b3f2-deb73c585cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.417827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9aabb9-1408-4f82-b3f2-deb73c585cc6 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.427452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 824/1629] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:43.428342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 806/1630] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:43.434991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9aabb9-1408-4f82-b3f2-deb73c585cc6 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.435517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600197ae-ef7d-41f4-b686-f2d50af7d245 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.543338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9aabb9-1408-4f82-b3f2-deb73c585cc6 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.552193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600197ae-ef7d-41f4-b686-f2d50af7d245 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.555938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344dc1-0070-4860-be55-d8b8f0b58669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.556614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344dc1-0070-4860-be55-d8b8f0b58669 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.563105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344dc1-0070-4860-be55-d8b8f0b58669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.563105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344dc1-0070-4860-be55-d8b8f0b58669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.563105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32344dc1-0070-4860-be55-d8b8f0b58669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.563459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c29b66-899f-409f-96c1-ecc0727945db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.563580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32344dc1-0070-4860-be55-d8b8f0b58669 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.563692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c29b66-899f-409f-96c1-ecc0727945db admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.563692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c29b66-899f-409f-96c1-ecc0727945db admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.563692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c29b66-899f-409f-96c1-ecc0727945db admin admin] PATH_INFO: `/v3/projects/64832a07c8e640e7ace563026eed099c/users/07c04cf94bec49b0bac7083ceaff2f15/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.579055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 825/1631] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:43.582735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344dc1-0070-4860-be55-d8b8f0b58669 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.585141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c29b66-899f-409f-96c1-ecc0727945db admin admin] RBAC: Authorizing `identity:create_grant(project_id=64832a07c8e640e7ace563026eed099c, user_id=07c04cf94bec49b0bac7083ceaff2f15, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.588383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c29b66-899f-409f-96c1-ecc0727945db admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.604287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344dc1-0070-4860-be55-d8b8f0b58669 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.609418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8f161-e684-4f38-9fe5-96d0e423ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.610267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8f161-e684-4f38-9fe5-96d0e423ee74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.610545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8f161-e684-4f38-9fe5-96d0e423ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.610864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8f161-e684-4f38-9fe5-96d0e423ee74 admin admin] PATH_INFO: `/v3/projects/5d9898beacf94b5d9112913f8f0e8aa0/users/7854d533fdc54fcf96c343b244486dc5/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.635371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8f161-e684-4f38-9fe5-96d0e423ee74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9898beacf94b5d9112913f8f0e8aa0, user_id=7854d533fdc54fcf96c343b244486dc5, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.639798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8f161-e684-4f38-9fe5-96d0e423ee74 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.711476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 807/1632] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:43 2022] PUT /identity/v3/projects/64832a07c8e640e7ace563026eed099c/users/07c04cf94bec49b0bac7083ceaff2f15/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:43.712736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c29b66-899f-409f-96c1-ecc0727945db admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.761739 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 826/1633] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:43 2022] PUT /identity/v3/projects/5d9898beacf94b5d9112913f8f0e8aa0/users/7854d533fdc54fcf96c343b244486dc5/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:43.766173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8f161-e684-4f38-9fe5-96d0e423ee74 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.792440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c29b66-899f-409f-96c1-ecc0727945db admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.845529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8f161-e684-4f38-9fe5-96d0e423ee74 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.850720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320293b5-83a4-4d15-88b8-2778bca57b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.851691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320293b5-83a4-4d15-88b8-2778bca57b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.851916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320293b5-83a4-4d15-88b8-2778bca57b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.852332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320293b5-83a4-4d15-88b8-2778bca57b63 admin admin] PATH_INFO: `/v3/projects/6c472f9397604d17a397056103214c5c/users/54696bf723894963891d361acc48eda9/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.854284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320293b5-83a4-4d15-88b8-2778bca57b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c472f9397604d17a397056103214c5c, user_id=54696bf723894963891d361acc48eda9, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.856993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320293b5-83a4-4d15-88b8-2778bca57b63 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.858111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafec0de-f32c-48e3-8447-47c3c763f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.858796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafec0de-f32c-48e3-8447-47c3c763f5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.859204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafec0de-f32c-48e3-8447-47c3c763f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.859538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafec0de-f32c-48e3-8447-47c3c763f5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.860433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafec0de-f32c-48e3-8447-47c3c763f5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.862456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafec0de-f32c-48e3-8447-47c3c763f5f2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.868348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 827/1634] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:43 2022] PUT /identity/v3/projects/6c472f9397604d17a397056103214c5c/users/54696bf723894963891d361acc48eda9/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:43.874925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320293b5-83a4-4d15-88b8-2778bca57b63 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.877107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:43.935335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320293b5-83a4-4d15-88b8-2778bca57b63 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.940136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f6fe6-24be-4c50-b667-199536251864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.940738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f6fe6-24be-4c50-b667-199536251864 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.941012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f6fe6-24be-4c50-b667-199536251864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.941282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f6fe6-24be-4c50-b667-199536251864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.941920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f6fe6-24be-4c50-b667-199536251864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.943684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f6fe6-24be-4c50-b667-199536251864 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:43.954149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 828/1635] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:43.955314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad2aa-347c-464b-ade6-a07dcda69578 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.955596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad2aa-347c-464b-ade6-a07dcda69578 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.956099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad2aa-347c-464b-ade6-a07dcda69578 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.957479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 829/1636] 10.222.0.13 () {54 vars in 912 bytes} [Wed Aug 31 11:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:43.957994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ad2aa-347c-464b-ade6-a07dcda69578 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:43.966863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 808/1637] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:43 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:43.970959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34783a-8cf9-40e2-92d2-3a1332934c3f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.970959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34783a-8cf9-40e2-92d2-3a1332934c3f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.970959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34783a-8cf9-40e2-92d2-3a1332934c3f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.970959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 809/1638] 10.222.0.13 () {54 vars in 912 bytes} [Wed Aug 31 11:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:43.971879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b5df-ee6e-4446-b942-9b330db66173 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.972220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b5df-ee6e-4446-b942-9b330db66173 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.972556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b5df-ee6e-4446-b942-9b330db66173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.975006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ad2aa-347c-464b-ade6-a07dcda69578 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:43.980066 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:43.993071 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0151a-9573-43cf-bafa-95c492a2494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:43.993758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0151a-9573-43cf-bafa-95c492a2494a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:43.994241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0151a-9573-43cf-bafa-95c492a2494a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:43.994738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0151a-9573-43cf-bafa-95c492a2494a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:43.996004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0151a-9573-43cf-bafa-95c492a2494a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:43.997675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0151a-9573-43cf-bafa-95c492a2494a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.004046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c5c7b5df-ee6e-4446-b942-9b330db66173 None None] MFA Rules not processed for user `54696bf723894963891d361acc48eda9`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:44.307415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c5c7b5df-ee6e-4446-b942-9b330db66173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:44.308622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 830/1639] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:44.308622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0151a-9573-43cf-bafa-95c492a2494a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.308622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0151a-9573-43cf-bafa-95c492a2494a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.308622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c456b9-a7fe-4cd0-8bca-6825673d3e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.309529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c456b9-a7fe-4cd0-8bca-6825673d3e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.309529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c456b9-a7fe-4cd0-8bca-6825673d3e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.309529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c456b9-a7fe-4cd0-8bca-6825673d3e36 admin admin] PATH_INFO: `/v3/projects/64832a07c8e640e7ace563026eed099c/users/07c04cf94bec49b0bac7083ceaff2f15/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.309529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c456b9-a7fe-4cd0-8bca-6825673d3e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64832a07c8e640e7ace563026eed099c, user_id=07c04cf94bec49b0bac7083ceaff2f15, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.309529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c456b9-a7fe-4cd0-8bca-6825673d3e36 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.309881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 831/1640] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:44 2022] PUT /identity/v3/projects/64832a07c8e640e7ace563026eed099c/users/07c04cf94bec49b0bac7083ceaff2f15/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:44.309881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc515b42-a109-448b-ab35-04e0e4e31ce3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.309881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc515b42-a109-448b-ab35-04e0e4e31ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.309881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc515b42-a109-448b-ab35-04e0e4e31ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.309881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fc515b42-a109-448b-ab35-04e0e4e31ce3 None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:44.311229 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fc515b42-a109-448b-ab35-04e0e4e31ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:44.311384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 810/1641] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:44.311384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b5df-ee6e-4446-b942-9b330db66173 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.311384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b5df-ee6e-4446-b942-9b330db66173 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.311384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e325cfb-7d0f-4ed4-918f-59128f95e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.311775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e325cfb-7d0f-4ed4-918f-59128f95e69a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.311775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e325cfb-7d0f-4ed4-918f-59128f95e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.311775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e325cfb-7d0f-4ed4-918f-59128f95e69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.311775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e325cfb-7d0f-4ed4-918f-59128f95e69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.311775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e325cfb-7d0f-4ed4-918f-59128f95e69a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.312373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 832/1642] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:44.312373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd8cb4-95db-4d28-8829-209cc5147739 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.312373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd8cb4-95db-4d28-8829-209cc5147739 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.312373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd8cb4-95db-4d28-8829-209cc5147739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.312774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 811/1643] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:44.312774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e325cfb-7d0f-4ed4-918f-59128f95e69a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.312774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e325cfb-7d0f-4ed4-918f-59128f95e69a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.312774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d5816-6f42-4bce-9efd-7d593f170080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.313149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-84cd8cb4-95db-4d28-8829-209cc5147739 None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:44.313502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d5816-6f42-4bce-9efd-7d593f170080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.313502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d5816-6f42-4bce-9efd-7d593f170080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.313502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d5816-6f42-4bce-9efd-7d593f170080 admin admin] PATH_INFO: `/v3/projects/5d9898beacf94b5d9112913f8f0e8aa0/users/7854d533fdc54fcf96c343b244486dc5/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.314003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-84cd8cb4-95db-4d28-8829-209cc5147739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:44.314072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d5816-6f42-4bce-9efd-7d593f170080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9898beacf94b5d9112913f8f0e8aa0, user_id=7854d533fdc54fcf96c343b244486dc5, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.314072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d5816-6f42-4bce-9efd-7d593f170080 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.314204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 833/1644] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:44.314204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0e23b-4943-4c37-8422-a757ae6cca1b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.314204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0e23b-4943-4c37-8422-a757ae6cca1b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.314204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0e23b-4943-4c37-8422-a757ae6cca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.314450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 812/1645] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:44 2022] PUT /identity/v3/projects/5d9898beacf94b5d9112913f8f0e8aa0/users/7854d533fdc54fcf96c343b244486dc5/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:44.314450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d5816-6f42-4bce-9efd-7d593f170080 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.314575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d5a0e23b-4943-4c37-8422-a757ae6cca1b None None] MFA Rules not processed for user `07c04cf94bec49b0bac7083ceaff2f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:44.314575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d5a0e23b-4943-4c37-8422-a757ae6cca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:44.365003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d5816-6f42-4bce-9efd-7d593f170080 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.369175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18675f6-db1b-4d54-b61f-faf63c2c8dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.370002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18675f6-db1b-4d54-b61f-faf63c2c8dae service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.370352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18675f6-db1b-4d54-b61f-faf63c2c8dae service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.370728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18675f6-db1b-4d54-b61f-faf63c2c8dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.427303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:44.435236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 834/1646] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:44.435236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0e23b-4943-4c37-8422-a757ae6cca1b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.482470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18675f6-db1b-4d54-b61f-faf63c2c8dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.484746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18675f6-db1b-4d54-b61f-faf63c2c8dae service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.495811 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 813/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:44.496695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18675f6-db1b-4d54-b61f-faf63c2c8dae service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.505652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18675f6-db1b-4d54-b61f-faf63c2c8dae service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.509684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f45df6-f6d4-4157-a655-3f2c81fb69ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.510385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f45df6-f6d4-4157-a655-3f2c81fb69ea service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.510736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f45df6-f6d4-4157-a655-3f2c81fb69ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.511082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f45df6-f6d4-4157-a655-3f2c81fb69ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.522977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0e23b-4943-4c37-8422-a757ae6cca1b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.528743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d18f0-3894-4161-871c-c4b87fb8499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.529666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d18f0-3894-4161-871c-c4b87fb8499d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.530104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d18f0-3894-4161-871c-c4b87fb8499d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.530329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d18f0-3894-4161-871c-c4b87fb8499d admin admin] PATH_INFO: `/v3/projects/4453f116db104cb09f9d832c03d1ef68/users/782b7f03f7aa4445b8d751087077106d/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.567985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d18f0-3894-4161-871c-c4b87fb8499d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4453f116db104cb09f9d832c03d1ef68, user_id=782b7f03f7aa4445b8d751087077106d, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.570801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d18f0-3894-4161-871c-c4b87fb8499d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.625411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f45df6-f6d4-4157-a655-3f2c81fb69ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:44.626971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f45df6-f6d4-4157-a655-3f2c81fb69ea service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:44.643411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:44.654533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 814/1648] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:44.656179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a33ef-b709-4e1e-a0d9-2d46524d3b2d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.657032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a33ef-b709-4e1e-a0d9-2d46524d3b2d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.657862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a33ef-b709-4e1e-a0d9-2d46524d3b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.731280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 835/1649] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:44 2022] PUT /identity/v3/projects/4453f116db104cb09f9d832c03d1ef68/users/782b7f03f7aa4445b8d751087077106d/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:44.733023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d18f0-3894-4161-871c-c4b87fb8499d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:44.742477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6f7a33ef-b709-4e1e-a0d9-2d46524d3b2d None None] MFA Rules not processed for user `7854d533fdc54fcf96c343b244486dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:44.745240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6f7a33ef-b709-4e1e-a0d9-2d46524d3b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:44.889433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d18f0-3894-4161-871c-c4b87fb8499d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:44.901170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b5dfb-b73b-498f-8b4a-33542db9264a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:44.901997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5dfb-b73b-498f-8b4a-33542db9264a service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:44.902384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5dfb-b73b-498f-8b4a-33542db9264a service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:44.902761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5dfb-b73b-498f-8b4a-33542db9264a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:44.923774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 815/1650] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:44.925195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a33ef-b709-4e1e-a0d9-2d46524d3b2d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:45.030442 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a33ef-b709-4e1e-a0d9-2d46524d3b2d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.037556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f1767-cb9d-4ff9-8483-58a1926841ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:45.038362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f1767-cb9d-4ff9-8483-58a1926841ea admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.038749 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f1767-cb9d-4ff9-8483-58a1926841ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.040204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f1767-cb9d-4ff9-8483-58a1926841ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.041012 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f1767-cb9d-4ff9-8483-58a1926841ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.047991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f1767-cb9d-4ff9-8483-58a1926841ea admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.048116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b5dfb-b73b-498f-8b4a-33542db9264a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.048116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b5dfb-b73b-498f-8b4a-33542db9264a service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.057780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 816/1651] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:45.063319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f1767-cb9d-4ff9-8483-58a1926841ea admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:45.087106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 836/1652] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:45.088699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f1767-cb9d-4ff9-8483-58a1926841ea admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:45.094785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e33270-ae92-40d3-9449-a64ceac68902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:45.095480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e33270-ae92-40d3-9449-a64ceac68902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.095791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e33270-ae92-40d3-9449-a64ceac68902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.096046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e33270-ae92-40d3-9449-a64ceac68902 admin admin] PATH_INFO: `/v3/projects/4453f116db104cb09f9d832c03d1ef68/users/782b7f03f7aa4445b8d751087077106d/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.098969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e33270-ae92-40d3-9449-a64ceac68902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4453f116db104cb09f9d832c03d1ef68, user_id=782b7f03f7aa4445b8d751087077106d, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:45.101685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e33270-ae92-40d3-9449-a64ceac68902 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:45.113942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 817/1653] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:45 2022] PUT /identity/v3/projects/4453f116db104cb09f9d832c03d1ef68/users/782b7f03f7aa4445b8d751087077106d/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:45.124092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1db8c7-20d8-4420-bf33-e3c87ba0db75 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:45.124376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1db8c7-20d8-4420-bf33-e3c87ba0db75 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:45.125205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1db8c7-20d8-4420-bf33-e3c87ba0db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:45.150075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.157888 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ab1db8c7-20d8-4420-bf33-e3c87ba0db75 None None] MFA Rules not processed for user `782b7f03f7aa4445b8d751087077106d`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:45.159622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ab1db8c7-20d8-4420-bf33-e3c87ba0db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:45.270429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 837/1654] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:45.276355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:45.963530 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e33270-ae92-40d3-9449-a64ceac68902 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:46.097308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e33270-ae92-40d3-9449-a64ceac68902 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:46.106508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36dca-a0f6-4d2c-900a-2dd2f09eba58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:46.109719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36dca-a0f6-4d2c-900a-2dd2f09eba58 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:46.109719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36dca-a0f6-4d2c-900a-2dd2f09eba58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:46.109719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36dca-a0f6-4d2c-900a-2dd2f09eba58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:46.243772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd36dca-a0f6-4d2c-900a-2dd2f09eba58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:46.245361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd36dca-a0f6-4d2c-900a-2dd2f09eba58 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:46.273379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 818/1655] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:47.053900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1db8c7-20d8-4420-bf33-e3c87ba0db75 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:47.089507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1db8c7-20d8-4420-bf33-e3c87ba0db75 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:47.095266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36dca-a0f6-4d2c-900a-2dd2f09eba58 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:47.100098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafae3-c744-4d90-9004-c87e05509702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:47.101017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafae3-c744-4d90-9004-c87e05509702 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:47.101221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafae3-c744-4d90-9004-c87e05509702 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:47.101575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafae3-c744-4d90-9004-c87e05509702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:47.106957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36dca-a0f6-4d2c-900a-2dd2f09eba58 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:47.121416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdfebb-0ed7-463c-90b2-005ec0318d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:47.122032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdfebb-0ed7-463c-90b2-005ec0318d2f service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:47.122315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdfebb-0ed7-463c-90b2-005ec0318d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:47.122591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdfebb-0ed7-463c-90b2-005ec0318d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:47.135938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdfebb-0ed7-463c-90b2-005ec0318d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:47.143156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdfebb-0ed7-463c-90b2-005ec0318d2f service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:47.184986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 819/1656] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:47.233717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bafae3-c744-4d90-9004-c87e05509702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:47.235260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bafae3-c744-4d90-9004-c87e05509702 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:47.263639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 838/1657] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:47.809545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdfebb-0ed7-463c-90b2-005ec0318d2f service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:47.960723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:48.000255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdfebb-0ed7-463c-90b2-005ec0318d2f service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:48.011205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafae3-c744-4d90-9004-c87e05509702 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:48.022447 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafae3-c744-4d90-9004-c87e05509702 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:48.028518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b3a4f-a88c-412d-85e7-0666cb23ff08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:48.037789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:48.037789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:48.037789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:48.037789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] PATH_INFO: `/v3/users/271b9abc31904f949cfd769db8681e42` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:48.038820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b3a4f-a88c-412d-85e7-0666cb23ff08 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:48.038820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b3a4f-a88c-412d-85e7-0666cb23ff08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:48.038820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b3a4f-a88c-412d-85e7-0666cb23ff08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:48.041471 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271b9abc31904f949cfd769db8681e42)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:48.043606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:48.181731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b3a4f-a88c-412d-85e7-0666cb23ff08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:48.187402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b3a4f-a88c-412d-85e7-0666cb23ff08 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:48.213905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 839/1658] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:48.214801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b3a4f-a88c-412d-85e7-0666cb23ff08 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:48.227968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b3a4f-a88c-412d-85e7-0666cb23ff08 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:48.240498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72130725-9ea9-4549-81b1-a3573ee5223a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:48.241746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72130725-9ea9-4549-81b1-a3573ee5223a service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:48.242195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72130725-9ea9-4549-81b1-a3573ee5223a service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:48.242795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72130725-9ea9-4549-81b1-a3573ee5223a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:48.306996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:48.317718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271b9abc31904f949cfd769db8681e42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:48.333335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271b9abc31904f949cfd769db8681e42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:48.357075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271b9abc31904f949cfd769db8681e42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:48.364272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271b9abc31904f949cfd769db8681e42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:48.364366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271b9abc31904f949cfd769db8681e42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:48.368446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72130725-9ea9-4549-81b1-a3573ee5223a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:48.370983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72130725-9ea9-4549-81b1-a3573ee5223a service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:48.385810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 840/1659] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:48.450139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 820/1660] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:20:47 2022] DELETE /identity/v3/users/271b9abc31904f949cfd769db8681e42 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:48.451627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4ae7-c295-4b32-8548-566dd02a2df6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:48.451945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4ae7-c295-4b32-8548-566dd02a2df6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:48.452221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4ae7-c295-4b32-8548-566dd02a2df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:48.489945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ff9d4ae7-c295-4b32-8548-566dd02a2df6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:48.491213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ff9d4ae7-c295-4b32-8548-566dd02a2df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:48.600276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 841/1661] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:20:48.613807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:48.616050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:48.753936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dbd28-bcbd-4c37-80b3-dfdd4ca160e9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:48.758760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871f8a-ed03-48aa-b756-b6c0b735764f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:48.759399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871f8a-ed03-48aa-b756-b6c0b735764f service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:48.759680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871f8a-ed03-48aa-b756-b6c0b735764f service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:48.760524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871f8a-ed03-48aa-b756-b6c0b735764f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:48.772280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01871f8a-ed03-48aa-b756-b6c0b735764f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:48.774531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01871f8a-ed03-48aa-b756-b6c0b735764f service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:48.793240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 821/1662] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:49.644000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d4ae7-c295-4b32-8548-566dd02a2df6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:49.644633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ff9d4ae7-c295-4b32-8548-566dd02a2df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:49.677757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d4ae7-c295-4b32-8548-566dd02a2df6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:49.693869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:49.695195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:49.695494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:49.695802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] PATH_INFO: `/v3/projects/bc1929c3f8424efda20739cdb2723788` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:49.697070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1929c3f8424efda20739cdb2723788)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:49.699008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:49.884921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1929c3f8424efda20739cdb2723788', 'request_id': 'req-c91d3bc0-ed52-4056-a822-9867cea57f22'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:49.896917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1929c3f8424efda20739cdb2723788', 'request_id': 'req-c91d3bc0-ed52-4056-a822-9867cea57f22'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:49.910096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1929c3f8424efda20739cdb2723788', 'request_id': 'req-c91d3bc0-ed52-4056-a822-9867cea57f22'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:50.041619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] The token cache is being invalidate because project bc1929c3f8424efda20739cdb2723788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:20:50.043995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:50.043995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c91d3bc0-ed52-4056-a822-9867cea57f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:50.045456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 842/1663] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:20:49 2022] DELETE /identity/v3/projects/bc1929c3f8424efda20739cdb2723788 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:50.049860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871f8a-ed03-48aa-b756-b6c0b735764f service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:50.062902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871f8a-ed03-48aa-b756-b6c0b735764f service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:50.188750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:50.190623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:50.191466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:50.193561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] PATH_INFO: `/v3/users/54696bf723894963891d361acc48eda9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:50.198214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54696bf723894963891d361acc48eda9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:50.203618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:50.253165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:50.495585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54696bf723894963891d361acc48eda9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:50.506564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54696bf723894963891d361acc48eda9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:50.560230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54696bf723894963891d361acc48eda9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:50.561486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54696bf723894963891d361acc48eda9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:50.563042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54696bf723894963891d361acc48eda9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:50.649317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 822/1664] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:20:50 2022] DELETE /identity/v3/users/54696bf723894963891d361acc48eda9 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:51.387436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e294-a2e1-44c8-bc4a-dfbfca1ec488 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.388482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e294-a2e1-44c8-bc4a-dfbfca1ec488 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.388867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750e294-a2e1-44c8-bc4a-dfbfca1ec488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.419311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8750e294-a2e1-44c8-bc4a-dfbfca1ec488 None None] MFA Rules not processed for user `f83da62462fb4dc5aff180756de3d12f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:51.420726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8750e294-a2e1-44c8-bc4a-dfbfca1ec488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:51.444292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:51.450649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:51.480520 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:51.538082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 843/1665] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:51.548645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443856d-079a-47a2-b4f1-8d4e1b81049f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.553834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443856d-079a-47a2-b4f1-8d4e1b81049f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.553834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443856d-079a-47a2-b4f1-8d4e1b81049f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.580752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5ff88-a22a-4b29-ae4b-6a4803c532d1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:51.586650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:51.587903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:51.589549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:51.590189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] PATH_INFO: `/v3/projects/6c472f9397604d17a397056103214c5c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:51.592945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c472f9397604d17a397056103214c5c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:51.596202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:20:51.596202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 31 11:20:51.596202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: Aug 31 11:20:51.596202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:51.631656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d443856d-079a-47a2-b4f1-8d4e1b81049f None None] MFA Rules not processed for user `f83da62462fb4dc5aff180756de3d12f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:51.636832 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d443856d-079a-47a2-b4f1-8d4e1b81049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:51.650217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 844/1666] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:51.712223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443856d-079a-47a2-b4f1-8d4e1b81049f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:51.714911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d443856d-079a-47a2-b4f1-8d4e1b81049f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:51.793837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c472f9397604d17a397056103214c5c', 'request_id': 'req-830e0f7d-db8b-4699-a379-dd80972101b5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:51.846587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c472f9397604d17a397056103214c5c', 'request_id': 'req-830e0f7d-db8b-4699-a379-dd80972101b5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:51.879436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443856d-079a-47a2-b4f1-8d4e1b81049f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:51.950755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c472f9397604d17a397056103214c5c', 'request_id': 'req-830e0f7d-db8b-4699-a379-dd80972101b5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:51.979626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] The token cache is being invalidate because project 6c472f9397604d17a397056103214c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:20:51.979976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:51.983114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:51.993553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 823/1667] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:20:51 2022] DELETE /identity/v3/projects/6c472f9397604d17a397056103214c5c => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:51.993553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.000221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:52.123952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5a1bf-d1c8-44a4-8d50-504ca7b7e678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.124795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5a1bf-d1c8-44a4-8d50-504ca7b7e678 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.125086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5a1bf-d1c8-44a4-8d50-504ca7b7e678 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.126711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5a1bf-d1c8-44a4-8d50-504ca7b7e678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.130136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-88f5a1bf-d1c8-44a4-8d50-504ca7b7e678 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:52.198711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e0f7d-db8b-4699-a379-dd80972101b5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.217725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.219189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.219636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.220164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] PATH_INFO: `/v3/users/9078f78d2be04e63a4a0d5288263fe3d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.221599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9078f78d2be04e63a4a0d5288263fe3d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:52.223688 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:52.333479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5a1bf-d1c8-44a4-8d50-504ca7b7e678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:52.335446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5a1bf-d1c8-44a4-8d50-504ca7b7e678 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:52.349534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 845/1668] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:52.360487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b4ef-b53f-471e-a6e7-a3e96164a9e3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.361021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b4ef-b53f-471e-a6e7-a3e96164a9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.361489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b4ef-b53f-471e-a6e7-a3e96164a9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.395538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d8e9b4ef-b53f-471e-a6e7-a3e96164a9e3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:52.396887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d8e9b4ef-b53f-471e-a6e7-a3e96164a9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:52.419002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 846/1669] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:52.428344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7be07-f3ee-43b8-96c6-cac810c8e6d2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.428582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7be07-f3ee-43b8-96c6-cac810c8e6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.429434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7be07-f3ee-43b8-96c6-cac810c8e6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.473187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-85c7be07-f3ee-43b8-96c6-cac810c8e6d2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:52.474633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-85c7be07-f3ee-43b8-96c6-cac810c8e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:52.502214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 847/1670] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:52.502299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7be07-f3ee-43b8-96c6-cac810c8e6d2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.534487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7be07-f3ee-43b8-96c6-cac810c8e6d2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.552713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9078f78d2be04e63a4a0d5288263fe3d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:52.553234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca4235-0a60-42f7-bfe1-48a05b3d603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.553577 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca4235-0a60-42f7-bfe1-48a05b3d603f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.553676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca4235-0a60-42f7-bfe1-48a05b3d603f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.553932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca4235-0a60-42f7-bfe1-48a05b3d603f admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.554874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca4235-0a60-42f7-bfe1-48a05b3d603f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:52.555179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca4235-0a60-42f7-bfe1-48a05b3d603f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:52.557211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca4235-0a60-42f7-bfe1-48a05b3d603f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:52.572714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 848/1671] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:52.574140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42844f9-1cfd-49d7-a4a1-2a63cd262cc5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.574505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42844f9-1cfd-49d7-a4a1-2a63cd262cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.574852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42844f9-1cfd-49d7-a4a1-2a63cd262cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.596708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9078f78d2be04e63a4a0d5288263fe3d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:52.632390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9078f78d2be04e63a4a0d5288263fe3d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:52.634950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9078f78d2be04e63a4a0d5288263fe3d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:52.637271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9078f78d2be04e63a4a0d5288263fe3d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:52.643857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:52.645952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b42844f9-1cfd-49d7-a4a1-2a63cd262cc5 None None] MFA Rules not processed for user `713abcb6fbc1425a83aa794243ea93d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:52.647474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b42844f9-1cfd-49d7-a4a1-2a63cd262cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:52.746657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 824/1672] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:20:51 2022] DELETE /identity/v3/users/9078f78d2be04e63a4a0d5288263fe3d => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:52.747620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.750303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:52.793398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 849/1673] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:52.795453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71440710-039f-4880-815f-eb69d2fde12c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.795773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71440710-039f-4880-815f-eb69d2fde12c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.799286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71440710-039f-4880-815f-eb69d2fde12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.848318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-71440710-039f-4880-815f-eb69d2fde12c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:52.851159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-71440710-039f-4880-815f-eb69d2fde12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:52.857779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd2659-ffad-4515-be69-6921153da429 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:52.872724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 850/1674] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:52.873584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f38032-22b3-446b-8853-1b3cae4ea42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:52.873784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71440710-039f-4880-815f-eb69d2fde12c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:52.875256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f38032-22b3-446b-8853-1b3cae4ea42c admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:52.876027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f38032-22b3-446b-8853-1b3cae4ea42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:52.876626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f38032-22b3-446b-8853-1b3cae4ea42c admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:52.877617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f38032-22b3-446b-8853-1b3cae4ea42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:52.878904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-71440710-039f-4880-815f-eb69d2fde12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:52.879653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f38032-22b3-446b-8853-1b3cae4ea42c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.018545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71440710-039f-4880-815f-eb69d2fde12c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.027406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e05af-3659-45d5-b9da-2c9e440a1967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.028069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e05af-3659-45d5-b9da-2c9e440a1967 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.028541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e05af-3659-45d5-b9da-2c9e440a1967 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.029051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e05af-3659-45d5-b9da-2c9e440a1967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.046261 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 825/1675] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:52 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:53.047986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f38032-22b3-446b-8853-1b3cae4ea42c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.052034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-64f38032-22b3-446b-8853-1b3cae4ea42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:53.149227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e05af-3659-45d5-b9da-2c9e440a1967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.154881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e05af-3659-45d5-b9da-2c9e440a1967 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.180229 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 851/1676] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:53.180982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e05af-3659-45d5-b9da-2c9e440a1967 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.199659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e05af-3659-45d5-b9da-2c9e440a1967 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.222652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f38032-22b3-446b-8853-1b3cae4ea42c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.228708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a423c2e-50b1-4627-9a29-dee1bd51e93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.229472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a423c2e-50b1-4627-9a29-dee1bd51e93e service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.230244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a423c2e-50b1-4627-9a29-dee1bd51e93e service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.230531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a423c2e-50b1-4627-9a29-dee1bd51e93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.328572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19ba12-4828-45bb-adb8-107aab319eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.329823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19ba12-4828-45bb-adb8-107aab319eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.332317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19ba12-4828-45bb-adb8-107aab319eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.332713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19ba12-4828-45bb-adb8-107aab319eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.334047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19ba12-4828-45bb-adb8-107aab319eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.336010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a423c2e-50b1-4627-9a29-dee1bd51e93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.337504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a423c2e-50b1-4627-9a29-dee1bd51e93e service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.339317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19ba12-4828-45bb-adb8-107aab319eb2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.362445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 826/1677] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:53.364336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7955-d87a-4867-8866-af74eb759a98 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.364754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7955-d87a-4867-8866-af74eb759a98 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.365033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7955-d87a-4867-8866-af74eb759a98 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.366521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 827/1678] 10.222.0.13 () {54 vars in 912 bytes} [Wed Aug 31 11:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:53.376949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde3d8b-82ca-4632-a7e1-c3ee6fbf73c9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.376949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde3d8b-82ca-4632-a7e1-c3ee6fbf73c9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.377424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde3d8b-82ca-4632-a7e1-c3ee6fbf73c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.431893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4dde3d8b-82ca-4632-a7e1-c3ee6fbf73c9 None None] MFA Rules not processed for user `041de16601f342c1a9b18003773a0856`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:53.433750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4dde3d8b-82ca-4632-a7e1-c3ee6fbf73c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:53.458238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 852/1679] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:53 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:53.466945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19ba12-4828-45bb-adb8-107aab319eb2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.473566 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 828/1680] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:20:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:53.482876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19ba12-4828-45bb-adb8-107aab319eb2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.491392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde3d8b-82ca-4632-a7e1-c3ee6fbf73c9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.493684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10ff90-7433-4b54-83fb-ea1c8a447033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.494562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10ff90-7433-4b54-83fb-ea1c8a447033 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.495723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10ff90-7433-4b54-83fb-ea1c8a447033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.499537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10ff90-7433-4b54-83fb-ea1c8a447033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.499537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10ff90-7433-4b54-83fb-ea1c8a447033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.502412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10ff90-7433-4b54-83fb-ea1c8a447033 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.502746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde3d8b-82ca-4632-a7e1-c3ee6fbf73c9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.512395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d58f02-4444-4add-9e34-260db331fbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.513217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d58f02-4444-4add-9e34-260db331fbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.515083 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d58f02-4444-4add-9e34-260db331fbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.515723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d58f02-4444-4add-9e34-260db331fbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.526254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 853/1681] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:53.530437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10ff90-7433-4b54-83fb-ea1c8a447033 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.533630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d58f02-4444-4add-9e34-260db331fbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.535139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d58f02-4444-4add-9e34-260db331fbf7 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.545525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10ff90-7433-4b54-83fb-ea1c8a447033 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.551545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 829/1682] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:53.556368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577903e-21bc-4352-b747-59bbc1db4cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.556985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577903e-21bc-4352-b747-59bbc1db4cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.557477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577903e-21bc-4352-b747-59bbc1db4cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.557895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577903e-21bc-4352-b747-59bbc1db4cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.558706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577903e-21bc-4352-b747-59bbc1db4cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.560338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577903e-21bc-4352-b747-59bbc1db4cbe admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.572538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 854/1683] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:53.576826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d58f02-4444-4add-9e34-260db331fbf7 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:53.590154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d58f02-4444-4add-9e34-260db331fbf7 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:53.596880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c8a2d-5d53-4555-ad18-7e4a5c1462fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:53.597559 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c8a2d-5d53-4555-ad18-7e4a5c1462fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.597843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c8a2d-5d53-4555-ad18-7e4a5c1462fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.598178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c8a2d-5d53-4555-ad18-7e4a5c1462fc admin admin] PATH_INFO: `/v3/projects/2107e4f7dae74ae2aaf4c1f6f98d07c7/users/a0fe44914e19477e9b2230705f086609/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.617598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c8a2d-5d53-4555-ad18-7e4a5c1462fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2107e4f7dae74ae2aaf4c1f6f98d07c7, user_id=a0fe44914e19477e9b2230705f086609, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:53.620874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c8a2d-5d53-4555-ad18-7e4a5c1462fc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:53.739608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 830/1684] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:53 2022] PUT /identity/v3/projects/2107e4f7dae74ae2aaf4c1f6f98d07c7/users/a0fe44914e19477e9b2230705f086609/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:53.750561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0d936-9355-4877-bcf9-4f0fec7bfd57 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:53.752409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0d936-9355-4877-bcf9-4f0fec7bfd57 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:53.752826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0d936-9355-4877-bcf9-4f0fec7bfd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:53.782367 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:53.800779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d7d0d936-9355-4877-bcf9-4f0fec7bfd57 None None] MFA Rules not processed for user `a0fe44914e19477e9b2230705f086609`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:53.802333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d7d0d936-9355-4877-bcf9-4f0fec7bfd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:54.016615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 855/1685] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:54.021551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c8a2d-5d53-4555-ad18-7e4a5c1462fc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.158704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0d936-9355-4877-bcf9-4f0fec7bfd57 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.160976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d7d0d936-9355-4877-bcf9-4f0fec7bfd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:54.223972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c8a2d-5d53-4555-ad18-7e4a5c1462fc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.280480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453646b-d89a-4c12-b933-05fa95284bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.281055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453646b-d89a-4c12-b933-05fa95284bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.281339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453646b-d89a-4c12-b933-05fa95284bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.281616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453646b-d89a-4c12-b933-05fa95284bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.285088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453646b-d89a-4c12-b933-05fa95284bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.288871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453646b-d89a-4c12-b933-05fa95284bb0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.373379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0d936-9355-4877-bcf9-4f0fec7bfd57 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.412724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.412724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.412724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.412724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] PATH_INFO: `/v3/projects/991d68dded534f27ad5d92430f2ba147` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.413338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991d68dded534f27ad5d92430f2ba147)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.414176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.458820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 831/1686] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:54 2022] POST /identity/v3/projects => generated 379 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:54.464281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453646b-d89a-4c12-b933-05fa95284bb0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.464815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.603334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991d68dded534f27ad5d92430f2ba147', 'request_id': 'req-d587f90b-bbff-432c-9c6f-eac9763d6083'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:54.627467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991d68dded534f27ad5d92430f2ba147', 'request_id': 'req-d587f90b-bbff-432c-9c6f-eac9763d6083'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:54.633328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453646b-d89a-4c12-b933-05fa95284bb0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.642394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991d68dded534f27ad5d92430f2ba147', 'request_id': 'req-d587f90b-bbff-432c-9c6f-eac9763d6083'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:54.711045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b25ef-306f-4ef5-bcea-a02494b7bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.711664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b25ef-306f-4ef5-bcea-a02494b7bf63 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.711980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b25ef-306f-4ef5-bcea-a02494b7bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.712249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b25ef-306f-4ef5-bcea-a02494b7bf63 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.712888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b25ef-306f-4ef5-bcea-a02494b7bf63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:54.715407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b25ef-306f-4ef5-bcea-a02494b7bf63 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:54.776990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] The token cache is being invalidate because project 991d68dded534f27ad5d92430f2ba147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:20:54.776990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:54.776990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:54.776990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 856/1687] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:20:54 2022] DELETE /identity/v3/projects/991d68dded534f27ad5d92430f2ba147 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:20:54.776990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.791432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:54.888330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 832/1688] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:54 2022] POST /identity/v3/users => generated 296 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:54.888330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab1a2a-ab08-4205-b149-ccabfe2d4b81 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.888330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab1a2a-ab08-4205-b149-ccabfe2d4b81 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.888785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab1a2a-ab08-4205-b149-ccabfe2d4b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.895254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:54.928383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e9ab1a2a-ab08-4205-b149-ccabfe2d4b81 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:54.937577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e9ab1a2a-ab08-4205-b149-ccabfe2d4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:54.940683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587f90b-bbff-432c-9c6f-eac9763d6083 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:54.960368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216475e9-445f-4c97-9552-72b5a97c7f82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:54.961319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216475e9-445f-4c97-9552-72b5a97c7f82 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:54.964846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216475e9-445f-4c97-9552-72b5a97c7f82 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:54.965597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216475e9-445f-4c97-9552-72b5a97c7f82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:54.973786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-216475e9-445f-4c97-9552-72b5a97c7f82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:54.987256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 833/1689] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:54.988599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab1a2a-ab08-4205-b149-ccabfe2d4b81 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:54.989781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e9ab1a2a-ab08-4205-b149-ccabfe2d4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:55.003779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216475e9-445f-4c97-9552-72b5a97c7f82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.007094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216475e9-445f-4c97-9552-72b5a97c7f82 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.010709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab1a2a-ab08-4205-b149-ccabfe2d4b81 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.031884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb59b7c-2104-4e44-9bef-bad11f5486da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.032535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb59b7c-2104-4e44-9bef-bad11f5486da admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.032868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb59b7c-2104-4e44-9bef-bad11f5486da admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.033151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb59b7c-2104-4e44-9bef-bad11f5486da admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.033813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb59b7c-2104-4e44-9bef-bad11f5486da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.035559 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb59b7c-2104-4e44-9bef-bad11f5486da admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.051827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 834/1690] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:55.053291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1aeb37-801b-4131-9a01-570eda499364 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.053572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1aeb37-801b-4131-9a01-570eda499364 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.053857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1aeb37-801b-4131-9a01-570eda499364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.063111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 857/1691] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:55.063874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216475e9-445f-4c97-9552-72b5a97c7f82 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.078062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1a1aeb37-801b-4131-9a01-570eda499364 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:55.078752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1a1aeb37-801b-4131-9a01-570eda499364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:55.081435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216475e9-445f-4c97-9552-72b5a97c7f82 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.087086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedb57c-4cd3-4c41-8179-4420b16502d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.087985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedb57c-4cd3-4c41-8179-4420b16502d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.088361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedb57c-4cd3-4c41-8179-4420b16502d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.088732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedb57c-4cd3-4c41-8179-4420b16502d6 admin admin] PATH_INFO: `/v3/projects/e8526db9cb024360866d843f93334923/users/c8326ee829e4426aaf24cc651a2380c9/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.089795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 835/1692] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:55.101627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1aeb37-801b-4131-9a01-570eda499364 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.108796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedb57c-4cd3-4c41-8179-4420b16502d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8526db9cb024360866d843f93334923, user_id=c8326ee829e4426aaf24cc651a2380c9, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.111769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedb57c-4cd3-4c41-8179-4420b16502d6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.118527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1aeb37-801b-4131-9a01-570eda499364 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.125477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd710ae3-6c0c-46db-ad00-db4166072bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.126183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd710ae3-6c0c-46db-ad00-db4166072bdf admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.126873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd710ae3-6c0c-46db-ad00-db4166072bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.127215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd710ae3-6c0c-46db-ad00-db4166072bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.127989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd710ae3-6c0c-46db-ad00-db4166072bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:55.128354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd710ae3-6c0c-46db-ad00-db4166072bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.130040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd710ae3-6c0c-46db-ad00-db4166072bdf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.144668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 836/1693] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:20:55.148902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd710ae3-6c0c-46db-ad00-db4166072bdf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.166811 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd710ae3-6c0c-46db-ad00-db4166072bdf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.179096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3853ba-c0a3-4003-b310-a6cb3bb50767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.186113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3853ba-c0a3-4003-b310-a6cb3bb50767 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.186421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3853ba-c0a3-4003-b310-a6cb3bb50767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.186725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3853ba-c0a3-4003-b310-a6cb3bb50767 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.187416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3853ba-c0a3-4003-b310-a6cb3bb50767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.190755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3853ba-c0a3-4003-b310-a6cb3bb50767 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.228211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 858/1694] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:55 2022] PUT /identity/v3/projects/e8526db9cb024360866d843f93334923/users/c8326ee829e4426aaf24cc651a2380c9/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:55.236723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedb57c-4cd3-4c41-8179-4420b16502d6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.322907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 837/1695] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:55 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:20:55.324914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3853ba-c0a3-4003-b310-a6cb3bb50767 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.395783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:55.399576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedb57c-4cd3-4c41-8179-4420b16502d6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.490053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c950dfb-d9fc-43d5-a587-f8342e944cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.492146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c950dfb-d9fc-43d5-a587-f8342e944cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.492656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c950dfb-d9fc-43d5-a587-f8342e944cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.493104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c950dfb-d9fc-43d5-a587-f8342e944cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.493933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c950dfb-d9fc-43d5-a587-f8342e944cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.496341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c950dfb-d9fc-43d5-a587-f8342e944cc1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.509864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 859/1696] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:55.515264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c950dfb-d9fc-43d5-a587-f8342e944cc1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.527328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3853ba-c0a3-4003-b310-a6cb3bb50767 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.537523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c950dfb-d9fc-43d5-a587-f8342e944cc1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.544565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2262d6e-d82f-4df8-8c9b-5d6630c478a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.547601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2262d6e-d82f-4df8-8c9b-5d6630c478a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.548723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2262d6e-d82f-4df8-8c9b-5d6630c478a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.549268 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5256f1-09ce-438f-9ba4-8f63f925272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.549945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5256f1-09ce-438f-9ba4-8f63f925272b admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.550222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5256f1-09ce-438f-9ba4-8f63f925272b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.550734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2262d6e-d82f-4df8-8c9b-5d6630c478a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.552998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5256f1-09ce-438f-9ba4-8f63f925272b admin admin] PATH_INFO: `/v3/projects/e8526db9cb024360866d843f93334923/users/c8326ee829e4426aaf24cc651a2380c9/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.555473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5256f1-09ce-438f-9ba4-8f63f925272b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8526db9cb024360866d843f93334923, user_id=c8326ee829e4426aaf24cc651a2380c9, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.557823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2262d6e-d82f-4df8-8c9b-5d6630c478a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.560526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2262d6e-d82f-4df8-8c9b-5d6630c478a8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.561498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5256f1-09ce-438f-9ba4-8f63f925272b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.607794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 860/1697] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:55 2022] PUT /identity/v3/projects/e8526db9cb024360866d843f93334923/users/c8326ee829e4426aaf24cc651a2380c9/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:55.627002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df647b-387c-4d77-b102-347ebeb0af7f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.628132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df647b-387c-4d77-b102-347ebeb0af7f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.628410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df647b-387c-4d77-b102-347ebeb0af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.668586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-24df647b-387c-4d77-b102-347ebeb0af7f None None] MFA Rules not processed for user `c8326ee829e4426aaf24cc651a2380c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:55.669941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-24df647b-387c-4d77-b102-347ebeb0af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:55.713233 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 838/1698] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:55 2022] POST /identity/v3/users => generated 283 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:55.716951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2262d6e-d82f-4df8-8c9b-5d6630c478a8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.732785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2262d6e-d82f-4df8-8c9b-5d6630c478a8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:55.891311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 861/1699] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:55.927325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df647b-387c-4d77-b102-347ebeb0af7f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.928928 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-24df647b-387c-4d77-b102-347ebeb0af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:55.938657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368208d5-cd97-4661-8371-9262477636c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:55.940249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368208d5-cd97-4661-8371-9262477636c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:55.945617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368208d5-cd97-4661-8371-9262477636c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:55.946087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368208d5-cd97-4661-8371-9262477636c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:55.946973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368208d5-cd97-4661-8371-9262477636c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:55.948983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368208d5-cd97-4661-8371-9262477636c0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:55.976641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 839/1700] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:20:55.985185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368208d5-cd97-4661-8371-9262477636c0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:55.997502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368208d5-cd97-4661-8371-9262477636c0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:56.018709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f314-88be-462a-9c9a-1cfd14fb34df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:56.019609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f314-88be-462a-9c9a-1cfd14fb34df admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.020078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f314-88be-462a-9c9a-1cfd14fb34df admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.020563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6f314-88be-462a-9c9a-1cfd14fb34df admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.021505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6f314-88be-462a-9c9a-1cfd14fb34df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:56.023292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6f314-88be-462a-9c9a-1cfd14fb34df admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:56.067192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 840/1701] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:56.068270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f314-88be-462a-9c9a-1cfd14fb34df admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:56.095017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6f314-88be-462a-9c9a-1cfd14fb34df admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:56.111118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7212d-9cf8-40a8-a36f-d22cd35b0249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:56.112139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7212d-9cf8-40a8-a36f-d22cd35b0249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.113318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7212d-9cf8-40a8-a36f-d22cd35b0249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.113318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7212d-9cf8-40a8-a36f-d22cd35b0249 admin admin] PATH_INFO: `/v3/projects/26c04491d7e54bb1b8f5e8b66da80af3/users/bfb506fba9c24c388584fa4a5e14374c/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.113764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df647b-387c-4d77-b102-347ebeb0af7f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:56.120847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f2ca1-e704-4784-9c9c-604e9714611f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:56.121609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f2ca1-e704-4784-9c9c-604e9714611f service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.121992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f2ca1-e704-4784-9c9c-604e9714611f service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.122369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f2ca1-e704-4784-9c9c-604e9714611f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.171440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7212d-9cf8-40a8-a36f-d22cd35b0249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c04491d7e54bb1b8f5e8b66da80af3, user_id=bfb506fba9c24c388584fa4a5e14374c, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:56.172650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f2ca1-e704-4784-9c9c-604e9714611f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:56.175446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7212d-9cf8-40a8-a36f-d22cd35b0249 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:56.176938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f2ca1-e704-4784-9c9c-604e9714611f service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:56.206338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 862/1702] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:20:56.211008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f2ca1-e704-4784-9c9c-604e9714611f service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:56.212468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-478f2ca1-e704-4784-9c9c-604e9714611f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:56.254777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f2ca1-e704-4784-9c9c-604e9714611f service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:56.270588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:56.271353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.271639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.272075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] PATH_INFO: `/v3/users/dbf1e2002b3b474f8af0d2e5efecb412` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.275980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf1e2002b3b474f8af0d2e5efecb412)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:56.275980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 11:20:56.275980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 31 11:20:56.275980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: Aug 31 11:20:56.284525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:56.308446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 841/1703] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:56 2022] PUT /identity/v3/projects/26c04491d7e54bb1b8f5e8b66da80af3/users/bfb506fba9c24c388584fa4a5e14374c/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:20:56.322679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5964-beee-42df-ab5f-513981e018f5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.323056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5964-beee-42df-ab5f-513981e018f5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.323401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5964-beee-42df-ab5f-513981e018f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.391789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6cbe5964-beee-42df-ab5f-513981e018f5 None None] MFA Rules not processed for user `bfb506fba9c24c388584fa4a5e14374c`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:56.393327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6cbe5964-beee-42df-ab5f-513981e018f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:56.544959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 842/1704] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:20:56.550684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe5964-beee-42df-ab5f-513981e018f5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:56.552401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6cbe5964-beee-42df-ab5f-513981e018f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:56.618514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf1e2002b3b474f8af0d2e5efecb412'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:56.619404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf1e2002b3b474f8af0d2e5efecb412'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:56.676748 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe5964-beee-42df-ab5f-513981e018f5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:56.683712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:56.683712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.684076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.684311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.689067 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:56.694186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf1e2002b3b474f8af0d2e5efecb412'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:56.694186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf1e2002b3b474f8af0d2e5efecb412'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:56.705992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:56.734554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-888b342c-1748-47b8-b7a0-010feb7d1943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf1e2002b3b474f8af0d2e5efecb412'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:56.781305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 863/1705] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:20:56 2022] DELETE /identity/v3/users/dbf1e2002b3b474f8af0d2e5efecb412 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:56.789312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1c651-2507-4f43-8b14-d5874918052f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:56.789646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1c651-2507-4f43-8b14-d5874918052f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:56.789929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1c651-2507-4f43-8b14-d5874918052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:56.815719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c7e1c651-2507-4f43-8b14-d5874918052f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:56.817319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c7e1c651-2507-4f43-8b14-d5874918052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:56.840871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:56.841557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:56.897681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 843/1706] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:56.939607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 864/1707] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:56.953716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:56.955946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:57.034344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13f36d-2d8b-4b3a-958a-8230e1bcf9b3 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:57.057410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:57.106383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17168f7f-89a7-4fb4-99e6-0081b5224840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:57.107155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17168f7f-89a7-4fb4-99e6-0081b5224840 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.107464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17168f7f-89a7-4fb4-99e6-0081b5224840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.107842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17168f7f-89a7-4fb4-99e6-0081b5224840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.128461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17168f7f-89a7-4fb4-99e6-0081b5224840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:57.132192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17168f7f-89a7-4fb4-99e6-0081b5224840 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:57.162179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 844/1708] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:57.446454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1c651-2507-4f43-8b14-d5874918052f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:57.448314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c7e1c651-2507-4f43-8b14-d5874918052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:57.552861 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1c651-2507-4f43-8b14-d5874918052f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:57.558836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:57.560357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.560659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.560926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.563804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:57.650752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ef88a-d078-4774-b84a-303a1d56a065 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.653229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ef88a-d078-4774-b84a-303a1d56a065 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.653612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ef88a-d078-4774-b84a-303a1d56a065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.663938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:57.668951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:57.677789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8f3ef88a-d078-4774-b84a-303a1d56a065 None None] MFA Rules not processed for user `713abcb6fbc1425a83aa794243ea93d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:57.679034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8f3ef88a-d078-4774-b84a-303a1d56a065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:57.682974 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 865/1709] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:57.743169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 845/1710] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:57.826485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:57.828658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:57.870618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc977ea-e274-4dba-ad2a-55b3d1bf5f3e service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:57.885965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:57.891152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:57.891152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:57.891152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] PATH_INFO: `/v3/projects/41c9b8d7c4f64c4c8f0d0724905a5041` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:57.891152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c9b8d7c4f64c4c8f0d0724905a5041)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:57.891416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:58.060708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c9b8d7c4f64c4c8f0d0724905a5041', 'request_id': 'req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.083070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c9b8d7c4f64c4c8f0d0724905a5041', 'request_id': 'req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.095216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c9b8d7c4f64c4c8f0d0724905a5041', 'request_id': 'req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.102689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ef88a-d078-4774-b84a-303a1d56a065 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.105084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8f3ef88a-d078-4774-b84a-303a1d56a065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:58.123965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ef88a-d078-4774-b84a-303a1d56a065 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:58.202053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] The token cache is being invalidate because project 41c9b8d7c4f64c4c8f0d0724905a5041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:20:58.202905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.204025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33f3ef32-b978-4cb8-9a6d-4a6854e70aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.237695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 866/1711] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:20:57 2022] DELETE /identity/v3/projects/41c9b8d7c4f64c4c8f0d0724905a5041 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:58.239585 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee2ba-c23d-4401-9e6a-b0e821822dfd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.247959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee2ba-c23d-4401-9e6a-b0e821822dfd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.247959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee2ba-c23d-4401-9e6a-b0e821822dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.274917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-02eee2ba-c23d-4401-9e6a-b0e821822dfd None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:58.285365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-02eee2ba-c23d-4401-9e6a-b0e821822dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:58.309285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 867/1712] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:58.309368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:58.309368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.309368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.314020 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] PATH_INFO: `/v3/users/f98fad9667be4472a4dd7e9101daebf2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.314108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675737d1-85e6-488e-8096-a41c2819c18e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.314108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675737d1-85e6-488e-8096-a41c2819c18e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.314108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675737d1-85e6-488e-8096-a41c2819c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.317862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98fad9667be4472a4dd7e9101daebf2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:58.324057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:58.349686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-675737d1-85e6-488e-8096-a41c2819c18e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:58.351181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-675737d1-85e6-488e-8096-a41c2819c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:58.382251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 868/1713] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:58.386218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675737d1-85e6-488e-8096-a41c2819c18e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.398254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675737d1-85e6-488e-8096-a41c2819c18e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:58.403479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcb948-1310-4edb-830e-4c770376fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:58.404324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb948-1310-4edb-830e-4c770376fb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.404673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb948-1310-4edb-830e-4c770376fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.405013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb948-1310-4edb-830e-4c770376fb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.406419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcb948-1310-4edb-830e-4c770376fb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:20:58.406810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcb948-1310-4edb-830e-4c770376fb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:58.408649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcb948-1310-4edb-830e-4c770376fb41 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:58.422562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 869/1714] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:20:58.424095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c8c9c-c89b-4911-854c-ddaf4b3cadd0 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.428002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c8c9c-c89b-4911-854c-ddaf4b3cadd0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.428002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c8c9c-c89b-4911-854c-ddaf4b3cadd0 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.428002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 870/1715] 10.222.0.13 () {54 vars in 912 bytes} [Wed Aug 31 11:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:20:58.428002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c8c9c-c89b-4911-854c-ddaf4b3cadd0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.464597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c8c9c-c89b-4911-854c-ddaf4b3cadd0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:58.470275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d625a52-1954-4c41-981d-2331ba2cd864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:58.471120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625a52-1954-4c41-981d-2331ba2cd864 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.471563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625a52-1954-4c41-981d-2331ba2cd864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.472568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625a52-1954-4c41-981d-2331ba2cd864 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.473618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d625a52-1954-4c41-981d-2331ba2cd864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:58.476043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d625a52-1954-4c41-981d-2331ba2cd864 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:58.570788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98fad9667be4472a4dd7e9101daebf2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.591962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98fad9667be4472a4dd7e9101daebf2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.622553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98fad9667be4472a4dd7e9101daebf2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.623311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98fad9667be4472a4dd7e9101daebf2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.626121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98fad9667be4472a4dd7e9101daebf2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:20:58.643927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 871/1716] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:20:58 2022] POST /identity/v3/projects => generated 405 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:58.645648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24da6-3fdb-4166-a69f-b62aacfd61cc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.646216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24da6-3fdb-4166-a69f-b62aacfd61cc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.646635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24da6-3fdb-4166-a69f-b62aacfd61cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.735721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8bf24da6-3fdb-4166-a69f-b62aacfd61cc None None] MFA Rules not processed for user `041de16601f342c1a9b18003773a0856`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:58.740789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8bf24da6-3fdb-4166-a69f-b62aacfd61cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:58.740920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 846/1717] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:20:58 2022] DELETE /identity/v3/users/f98fad9667be4472a4dd7e9101daebf2 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:20:58.741991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.746259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:58.875203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 872/1718] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:20:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:58.876716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca833f6-603e-47ef-b788-8c164d70e9ae None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.877060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca833f6-603e-47ef-b788-8c164d70e9ae None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.877396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca833f6-603e-47ef-b788-8c164d70e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.894618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fc8ea-4cb1-456a-9a74-f08c88734ecc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:58.898257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:58.911187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b88df0-9dbe-4b0d-8031-01a3ae3b9bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:58.911187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b88df0-9dbe-4b0d-8031-01a3ae3b9bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:58.911187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b88df0-9dbe-4b0d-8031-01a3ae3b9bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:58.911187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b88df0-9dbe-4b0d-8031-01a3ae3b9bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:58.911492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b88df0-9dbe-4b0d-8031-01a3ae3b9bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:58.911492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b88df0-9dbe-4b0d-8031-01a3ae3b9bf8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:58.920039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2ca833f6-603e-47ef-b788-8c164d70e9ae None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:58.922615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2ca833f6-603e-47ef-b788-8c164d70e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:58.967400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 873/1719] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:58.968786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca833f6-603e-47ef-b788-8c164d70e9ae None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:58.972845 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2ca833f6-603e-47ef-b788-8c164d70e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:59.006465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca833f6-603e-47ef-b788-8c164d70e9ae None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.015300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b28ddd-c83c-4708-affe-d0a279c53fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.015300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b28ddd-c83c-4708-affe-d0a279c53fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.015300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b28ddd-c83c-4708-affe-d0a279c53fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.015300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b28ddd-c83c-4708-affe-d0a279c53fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.018613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 847/1720] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:20:58 2022] POST /identity/v3/users => generated 303 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:20:59.023551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b88df0-9dbe-4b0d-8031-01a3ae3b9bf8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.024398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b28ddd-c83c-4708-affe-d0a279c53fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.026418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b28ddd-c83c-4708-affe-d0a279c53fc3 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.035959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b88df0-9dbe-4b0d-8031-01a3ae3b9bf8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.038002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 874/1721] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:59.038877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b28ddd-c83c-4708-affe-d0a279c53fc3 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.040073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8bbc1-92d6-4655-9125-ef20143a29b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.040669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8bbc1-92d6-4655-9125-ef20143a29b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.040948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8bbc1-92d6-4655-9125-ef20143a29b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.041215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8bbc1-92d6-4655-9125-ef20143a29b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.052312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8bbc1-92d6-4655-9125-ef20143a29b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.054139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8bbc1-92d6-4655-9125-ef20143a29b8 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.058264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b28ddd-c83c-4708-affe-d0a279c53fc3 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.070112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998f44-4481-488e-9ffd-32206e975e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.070742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998f44-4481-488e-9ffd-32206e975e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.071024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998f44-4481-488e-9ffd-32206e975e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.072270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998f44-4481-488e-9ffd-32206e975e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.072270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998f44-4481-488e-9ffd-32206e975e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.074291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998f44-4481-488e-9ffd-32206e975e03 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.087627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 848/1722] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:59.091379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 875/1723] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:59.096299 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8bbc1-92d6-4655-9125-ef20143a29b8 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.106298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8bbc1-92d6-4655-9125-ef20143a29b8 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.111262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c1f6b-28c1-465d-8eda-6a6cae0a8c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.111916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c1f6b-28c1-465d-8eda-6a6cae0a8c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.112195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c1f6b-28c1-465d-8eda-6a6cae0a8c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.112473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c1f6b-28c1-465d-8eda-6a6cae0a8c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.113110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c1f6b-28c1-465d-8eda-6a6cae0a8c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.119911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c1f6b-28c1-465d-8eda-6a6cae0a8c85 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.141506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 849/1724] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:20:59.145611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998f44-4481-488e-9ffd-32206e975e03 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.162101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998f44-4481-488e-9ffd-32206e975e03 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.170875 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86d88f-12a1-41aa-8347-14dfb78fbe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.172285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86d88f-12a1-41aa-8347-14dfb78fbe8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.172774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86d88f-12a1-41aa-8347-14dfb78fbe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.173238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86d88f-12a1-41aa-8347-14dfb78fbe8d admin admin] PATH_INFO: `/v3/projects/902f2a168a9d48dd8bff326fdddd297a/users/1d069ae0f4ce4b7086c360ddc098931b/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.237437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86d88f-12a1-41aa-8347-14dfb78fbe8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=902f2a168a9d48dd8bff326fdddd297a, user_id=1d069ae0f4ce4b7086c360ddc098931b, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.240256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86d88f-12a1-41aa-8347-14dfb78fbe8d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.338767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:20:59.377306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 876/1725] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:20:59 2022] PUT /identity/v3/projects/902f2a168a9d48dd8bff326fdddd297a/users/1d069ae0f4ce4b7086c360ddc098931b/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:20:59.379172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7dc51-9f18-4bdf-9459-6a43debf8837 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.379468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7dc51-9f18-4bdf-9459-6a43debf8837 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.379772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7dc51-9f18-4bdf-9459-6a43debf8837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.414024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-fbf7dc51-9f18-4bdf-9459-6a43debf8837 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:20:59.415720 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fbf7dc51-9f18-4bdf-9459-6a43debf8837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:20:59.527387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 850/1726] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:20:59.547293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86d88f-12a1-41aa-8347-14dfb78fbe8d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.675043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86d88f-12a1-41aa-8347-14dfb78fbe8d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:20:59.682874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3ebd6-4c72-40cd-a99d-80d4d4bb0f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:20:59.685075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3ebd6-4c72-40cd-a99d-80d4d4bb0f07 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:20:59.685401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3ebd6-4c72-40cd-a99d-80d4d4bb0f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:20:59.685706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3ebd6-4c72-40cd-a99d-80d4d4bb0f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:20:59.715359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3ebd6-4c72-40cd-a99d-80d4d4bb0f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:20:59.717062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3ebd6-4c72-40cd-a99d-80d4d4bb0f07 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:20:59.746227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 877/1727] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:20:59.988306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7dc51-9f18-4bdf-9459-6a43debf8837 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:20:59.989790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fbf7dc51-9f18-4bdf-9459-6a43debf8837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:00.024455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7dc51-9f18-4bdf-9459-6a43debf8837 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:00.045336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:00.046372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.046804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.047226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] PATH_INFO: `/v3/projects/5c412abfa55544f1be0ceb414b6415b2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:00.048764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c412abfa55544f1be0ceb414b6415b2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:00.051091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:00.212463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c412abfa55544f1be0ceb414b6415b2', 'request_id': 'req-6668b560-1f4c-4f15-9b76-e30214a4352c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:00.223016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c412abfa55544f1be0ceb414b6415b2', 'request_id': 'req-6668b560-1f4c-4f15-9b76-e30214a4352c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:00.320982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c412abfa55544f1be0ceb414b6415b2', 'request_id': 'req-6668b560-1f4c-4f15-9b76-e30214a4352c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:00.336063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] The token cache is being invalidate because project 5c412abfa55544f1be0ceb414b6415b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:00.336063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:00.336510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6668b560-1f4c-4f15-9b76-e30214a4352c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:00.338252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 851/1728] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:20:59 2022] DELETE /identity/v3/projects/5c412abfa55544f1be0ceb414b6415b2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:00.342457 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3ebd6-4c72-40cd-a99d-80d4d4bb0f07 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:00.371063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3ebd6-4c72-40cd-a99d-80d4d4bb0f07 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:00.402722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b7fc-bb4c-40e7-81cf-8b4bbd4aa62d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.403124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b7fc-bb4c-40e7-81cf-8b4bbd4aa62d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.403515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b7fc-bb4c-40e7-81cf-8b4bbd4aa62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:00.469029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7b81b7fc-bb4c-40e7-81cf-8b4bbd4aa62d None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:00.470496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7b81b7fc-bb4c-40e7-81cf-8b4bbd4aa62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:00.481442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:00.482630 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:00.484159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:00.484159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] PATH_INFO: `/v3/users/7854d533fdc54fcf96c343b244486dc5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:00.487388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7854d533fdc54fcf96c343b244486dc5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:00.490406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:00.558709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 852/1729] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:21:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:00.795638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:00.801865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81b7fc-bb4c-40e7-81cf-8b4bbd4aa62d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:00.805977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7b81b7fc-bb4c-40e7-81cf-8b4bbd4aa62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:00.824225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7854d533fdc54fcf96c343b244486dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:00.826966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7854d533fdc54fcf96c343b244486dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:00.967220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7854d533fdc54fcf96c343b244486dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:00.968069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7854d533fdc54fcf96c343b244486dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:00.990277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ef759870-aafe-4ef0-a32f-67f2eaa2f653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7854d533fdc54fcf96c343b244486dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:01.003011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81b7fc-bb4c-40e7-81cf-8b4bbd4aa62d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:01.006632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 878/1730] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:00 2022] DELETE /identity/v3/users/7854d533fdc54fcf96c343b244486dc5 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:01.010187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:01.010891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.011175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.011477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.013388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:01.025651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:01.027457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:01.040582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 853/1731] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:21:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 11:21:01.458951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:01.616004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5bd7-9fb6-463d-bd3a-17dece92d370 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.616676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5bd7-9fb6-463d-bd3a-17dece92d370 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.617140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a5bd7-9fb6-463d-bd3a-17dece92d370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.656252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fa5a5bd7-9fb6-463d-bd3a-17dece92d370 None None] MFA Rules not processed for user `041de16601f342c1a9b18003773a0856`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:01.657919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fa5a5bd7-9fb6-463d-bd3a-17dece92d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:01.732443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 879/1732] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Aug 31 11:21:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:01.756577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:01.758880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:01.862958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777aedb-54c0-4cac-800e-2e842f24439d service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:01.868538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d7bc2-b234-4e1c-8f58-17f00b4e2462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:01.869910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d7bc2-b234-4e1c-8f58-17f00b4e2462 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:01.870396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d7bc2-b234-4e1c-8f58-17f00b4e2462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:01.870765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d7bc2-b234-4e1c-8f58-17f00b4e2462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:01.884939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d7bc2-b234-4e1c-8f58-17f00b4e2462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:01.894612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d7bc2-b234-4e1c-8f58-17f00b4e2462 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:01.910974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 854/1733] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:02.023778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b40a2-169b-4986-bb9c-8d892e9ef2a1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.024329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b40a2-169b-4986-bb9c-8d892e9ef2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.024428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b40a2-169b-4986-bb9c-8d892e9ef2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.112170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1f1b40a2-169b-4986-bb9c-8d892e9ef2a1 None None] MFA Rules not processed for user `1d069ae0f4ce4b7086c360ddc098931b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:02.115204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1f1b40a2-169b-4986-bb9c-8d892e9ef2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:02.187704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d7bc2-b234-4e1c-8f58-17f00b4e2462 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:02.189389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-264d7bc2-b234-4e1c-8f58-17f00b4e2462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:02.366749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 880/1734] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:02.376720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b40a2-169b-4986-bb9c-8d892e9ef2a1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:02.385037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1f1b40a2-169b-4986-bb9c-8d892e9ef2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:02.401034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d7bc2-b234-4e1c-8f58-17f00b4e2462 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:02.407545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:02.409988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.409988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.409988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] PATH_INFO: `/v3/projects/5d9898beacf94b5d9112913f8f0e8aa0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.411134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9898beacf94b5d9112913f8f0e8aa0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:02.420755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:02.453298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b40a2-169b-4986-bb9c-8d892e9ef2a1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:02.618385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de698-1c2b-44f5-bc1c-acd9cae3e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:02.618385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de698-1c2b-44f5-bc1c-acd9cae3e838 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:02.618385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de698-1c2b-44f5-bc1c-acd9cae3e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:02.618385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935de698-1c2b-44f5-bc1c-acd9cae3e838 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:02.618789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de698-1c2b-44f5-bc1c-acd9cae3e838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:02.618789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935de698-1c2b-44f5-bc1c-acd9cae3e838 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:02.988919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 881/1735] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:02 2022] POST /identity/v3/projects => generated 405 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:02.996335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de698-1c2b-44f5-bc1c-acd9cae3e838 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.015661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9898beacf94b5d9112913f8f0e8aa0', 'request_id': 'req-2a394b45-7612-4f42-9b42-398dc31598fb'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:03.046423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9898beacf94b5d9112913f8f0e8aa0', 'request_id': 'req-2a394b45-7612-4f42-9b42-398dc31598fb'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:03.184836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935de698-1c2b-44f5-bc1c-acd9cae3e838 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.199531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7e4b3-da74-47f0-84eb-3bac00d92dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.200215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7e4b3-da74-47f0-84eb-3bac00d92dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.200649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7e4b3-da74-47f0-84eb-3bac00d92dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.201062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7e4b3-da74-47f0-84eb-3bac00d92dcc admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.202005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7e4b3-da74-47f0-84eb-3bac00d92dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.204808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7e4b3-da74-47f0-84eb-3bac00d92dcc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.259164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9898beacf94b5d9112913f8f0e8aa0', 'request_id': 'req-2a394b45-7612-4f42-9b42-398dc31598fb'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:03.262653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] The token cache is being invalidate because project 5d9898beacf94b5d9112913f8f0e8aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:03.263132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:03.264071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a394b45-7612-4f42-9b42-398dc31598fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:03.266881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 855/1736] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:02 2022] DELETE /identity/v3/projects/5d9898beacf94b5d9112913f8f0e8aa0 => generated 0 bytes in 1080 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:03.271733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5858a03-fcbc-41e1-bdab-5cead0c4f9fb None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.272331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5858a03-fcbc-41e1-bdab-5cead0c4f9fb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.272816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5858a03-fcbc-41e1-bdab-5cead0c4f9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.302357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f5858a03-fcbc-41e1-bdab-5cead0c4f9fb None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:03.303809 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f5858a03-fcbc-41e1-bdab-5cead0c4f9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:03.315542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 856/1737] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:03.325528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab370d9-d88e-45fd-b04c-a5ce268e45e9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.326128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab370d9-d88e-45fd-b04c-a5ce268e45e9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.326609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab370d9-d88e-45fd-b04c-a5ce268e45e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.349992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 882/1738] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:02 2022] POST /identity/v3/users => generated 309 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:03.351430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7e4b3-da74-47f0-84eb-3bac00d92dcc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.353831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d8a7e4b3-da74-47f0-84eb-3bac00d92dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:03.358029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5ab370d9-d88e-45fd-b04c-a5ce268e45e9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:03.360339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5ab370d9-d88e-45fd-b04c-a5ce268e45e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:03.368976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7e4b3-da74-47f0-84eb-3bac00d92dcc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.371517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 857/1739] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:03.377409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab370d9-d88e-45fd-b04c-a5ce268e45e9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.389174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4f22e-c2dd-46b0-9183-7cfcee565160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.389174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4f22e-c2dd-46b0-9183-7cfcee565160 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.389804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4f22e-c2dd-46b0-9183-7cfcee565160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.390238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4f22e-c2dd-46b0-9183-7cfcee565160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.391049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4f22e-c2dd-46b0-9183-7cfcee565160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.397080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab370d9-d88e-45fd-b04c-a5ce268e45e9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.404717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129591a-338f-41e3-af68-4b1d1bbd77a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.405596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129591a-338f-41e3-af68-4b1d1bbd77a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.406044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129591a-338f-41e3-af68-4b1d1bbd77a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.406613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129591a-338f-41e3-af68-4b1d1bbd77a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.407555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129591a-338f-41e3-af68-4b1d1bbd77a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:03.408514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129591a-338f-41e3-af68-4b1d1bbd77a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.410527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129591a-338f-41e3-af68-4b1d1bbd77a6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.410706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4f22e-c2dd-46b0-9183-7cfcee565160 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.454571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 883/1740] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:03.455515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4f22e-c2dd-46b0-9183-7cfcee565160 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.464993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:03.470400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4f22e-c2dd-46b0-9183-7cfcee565160 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.482170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a67e64-6e31-44c9-a777-bc832c051115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.482170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a67e64-6e31-44c9-a777-bc832c051115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.482170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a67e64-6e31-44c9-a777-bc832c051115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.482170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a67e64-6e31-44c9-a777-bc832c051115 admin admin] PATH_INFO: `/v3/projects/63cb7a1637a749978431415c69b5b695/users/38a455340ad04762b886fccb8adcd8de/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.490741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 858/1741] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:03.492241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129591a-338f-41e3-af68-4b1d1bbd77a6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.503926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a67e64-6e31-44c9-a777-bc832c051115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cb7a1637a749978431415c69b5b695, user_id=38a455340ad04762b886fccb8adcd8de, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.508608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a67e64-6e31-44c9-a777-bc832c051115 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.519337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129591a-338f-41e3-af68-4b1d1bbd77a6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.532693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc176f5e-991d-4c95-bfb6-64f5fc283b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.533790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc176f5e-991d-4c95-bfb6-64f5fc283b2e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.534136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc176f5e-991d-4c95-bfb6-64f5fc283b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.536874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc176f5e-991d-4c95-bfb6-64f5fc283b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.537615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc176f5e-991d-4c95-bfb6-64f5fc283b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.539713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc176f5e-991d-4c95-bfb6-64f5fc283b2e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.627801 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 884/1742] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:03 2022] PUT /identity/v3/projects/63cb7a1637a749978431415c69b5b695/users/38a455340ad04762b886fccb8adcd8de/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:03.629597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a67e64-6e31-44c9-a777-bc832c051115 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.700395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 859/1743] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:03 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:03.702992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceedc60-b7f4-446b-866d-e11cc771e17a None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.703359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceedc60-b7f4-446b-866d-e11cc771e17a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.703685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceedc60-b7f4-446b-866d-e11cc771e17a None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.707080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 860/1744] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:21:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:03.709118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceedc60-b7f4-446b-866d-e11cc771e17a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:03.767867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a67e64-6e31-44c9-a777-bc832c051115 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.915842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceedc60-b7f4-446b-866d-e11cc771e17a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:03.924431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46fc36-b714-4abf-99e7-5dadcd3fc897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.925649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46fc36-b714-4abf-99e7-5dadcd3fc897 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.925932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46fc36-b714-4abf-99e7-5dadcd3fc897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.926533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46fc36-b714-4abf-99e7-5dadcd3fc897 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.929123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46fc36-b714-4abf-99e7-5dadcd3fc897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.933453 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46fc36-b714-4abf-99e7-5dadcd3fc897 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.941773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6f263-3833-4fc5-b80c-f13302d8780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:03.943311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6f263-3833-4fc5-b80c-f13302d8780a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.943311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6f263-3833-4fc5-b80c-f13302d8780a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.943311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6f263-3833-4fc5-b80c-f13302d8780a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:03.943816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6f263-3833-4fc5-b80c-f13302d8780a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:03.952331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6f263-3833-4fc5-b80c-f13302d8780a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:03.981534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 885/1745] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:21:03.981534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c17c3f-f3b0-406c-bb13-4a3e3a372c40 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:03.981534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c17c3f-f3b0-406c-bb13-4a3e3a372c40 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:03.981534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c17c3f-f3b0-406c-bb13-4a3e3a372c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.051565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-59c17c3f-f3b0-406c-bb13-4a3e3a372c40 None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:04.051565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-59c17c3f-f3b0-406c-bb13-4a3e3a372c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:04.058595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 861/1746] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:03 2022] POST /identity/v3/users => generated 294 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:04.058595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46fc36-b714-4abf-99e7-5dadcd3fc897 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.062863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46fc36-b714-4abf-99e7-5dadcd3fc897 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.070190 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068bfd6-ddfa-46e8-8fff-c5269946abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.071148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068bfd6-ddfa-46e8-8fff-c5269946abaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.071428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068bfd6-ddfa-46e8-8fff-c5269946abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.071725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068bfd6-ddfa-46e8-8fff-c5269946abaf admin admin] PATH_INFO: `/v3/projects/63cb7a1637a749978431415c69b5b695/users/38a455340ad04762b886fccb8adcd8de/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.074316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068bfd6-ddfa-46e8-8fff-c5269946abaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cb7a1637a749978431415c69b5b695, user_id=38a455340ad04762b886fccb8adcd8de, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.078027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068bfd6-ddfa-46e8-8fff-c5269946abaf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.099816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 862/1747] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:04 2022] PUT /identity/v3/projects/63cb7a1637a749978431415c69b5b695/users/38a455340ad04762b886fccb8adcd8de/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:04.100755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068bfd6-ddfa-46e8-8fff-c5269946abaf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.193466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 886/1748] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:21:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:04.208485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c17c3f-f3b0-406c-bb13-4a3e3a372c40 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.210890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-59c17c3f-f3b0-406c-bb13-4a3e3a372c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:04.238000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c17c3f-f3b0-406c-bb13-4a3e3a372c40 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.269707 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068bfd6-ddfa-46e8-8fff-c5269946abaf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.273431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:04.282510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd7f1c-51cb-412f-b5fb-9a29dcfc95e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.282510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd7f1c-51cb-412f-b5fb-9a29dcfc95e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.282510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd7f1c-51cb-412f-b5fb-9a29dcfc95e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.282510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd7f1c-51cb-412f-b5fb-9a29dcfc95e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.282908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd7f1c-51cb-412f-b5fb-9a29dcfc95e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.296942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd7f1c-51cb-412f-b5fb-9a29dcfc95e2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.318020 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 863/1749] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:04.323893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd7f1c-51cb-412f-b5fb-9a29dcfc95e2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.336405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd7f1c-51cb-412f-b5fb-9a29dcfc95e2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.349860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f436c-3961-4cef-8dee-b5cb7122455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.351823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f436c-3961-4cef-8dee-b5cb7122455f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.357248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f436c-3961-4cef-8dee-b5cb7122455f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.357638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f436c-3961-4cef-8dee-b5cb7122455f admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.359145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f436c-3961-4cef-8dee-b5cb7122455f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.361082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f436c-3961-4cef-8dee-b5cb7122455f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.394961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 864/1750] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:04.402383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f436c-3961-4cef-8dee-b5cb7122455f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.409993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aad90a-e1d8-4cd7-be95-1cfed0507d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.412662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aad90a-e1d8-4cd7-be95-1cfed0507d73 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.413222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aad90a-e1d8-4cd7-be95-1cfed0507d73 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.415056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aad90a-e1d8-4cd7-be95-1cfed0507d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.434551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f436c-3961-4cef-8dee-b5cb7122455f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.442241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3188-e974-427c-b4b5-d29fa1fb5282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.443040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3188-e974-427c-b4b5-d29fa1fb5282 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.443470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3188-e974-427c-b4b5-d29fa1fb5282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.443884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3188-e974-427c-b4b5-d29fa1fb5282 admin admin] PATH_INFO: `/v3/projects/c168893038f64688a9fecd24d05eefe2/users/cace5d6d6c9e4f0b83297bb4e710e454/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.445172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aad90a-e1d8-4cd7-be95-1cfed0507d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.448432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aad90a-e1d8-4cd7-be95-1cfed0507d73 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.473770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 887/1751] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:21:04.487274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d3188-e974-427c-b4b5-d29fa1fb5282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c168893038f64688a9fecd24d05eefe2, user_id=cace5d6d6c9e4f0b83297bb4e710e454, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.490216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d3188-e974-427c-b4b5-d29fa1fb5282 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:04.624521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 865/1752] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:04 2022] PUT /identity/v3/projects/c168893038f64688a9fecd24d05eefe2/users/cace5d6d6c9e4f0b83297bb4e710e454/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:04.637789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65c18a-45c9-440b-b1d3-8fd2e2c80a8f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.638219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65c18a-45c9-440b-b1d3-8fd2e2c80a8f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.638940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65c18a-45c9-440b-b1d3-8fd2e2c80a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.647200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:04.703124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8d65c18a-45c9-440b-b1d3-8fd2e2c80a8f None None] MFA Rules not processed for user `cace5d6d6c9e4f0b83297bb4e710e454`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:04.704722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8d65c18a-45c9-440b-b1d3-8fd2e2c80a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:04.834773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 888/1753] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:04.839014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3188-e974-427c-b4b5-d29fa1fb5282 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:04.981977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3188-e974-427c-b4b5-d29fa1fb5282 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:04.988456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0668f58-7dca-426a-ad9b-268bda31316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:04.989145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0668f58-7dca-426a-ad9b-268bda31316e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:04.991943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0668f58-7dca-426a-ad9b-268bda31316e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:04.991943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0668f58-7dca-426a-ad9b-268bda31316e admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:04.991943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0668f58-7dca-426a-ad9b-268bda31316e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:04.993995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0668f58-7dca-426a-ad9b-268bda31316e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:05.142686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 866/1754] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:04 2022] POST /identity/v3/projects => generated 387 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:05.143780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65c18a-45c9-440b-b1d3-8fd2e2c80a8f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.184287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65c18a-45c9-440b-b1d3-8fd2e2c80a8f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.289550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe598c0a-12af-49be-a492-7acb9a8f7a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.290474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe598c0a-12af-49be-a492-7acb9a8f7a03 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.295738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe598c0a-12af-49be-a492-7acb9a8f7a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.296705 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe598c0a-12af-49be-a492-7acb9a8f7a03 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.299671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe598c0a-12af-49be-a492-7acb9a8f7a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:05.301693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe598c0a-12af-49be-a492-7acb9a8f7a03 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:05.412185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 889/1755] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:05 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:05.416781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0668f58-7dca-426a-ad9b-268bda31316e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.464558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0668f58-7dca-426a-ad9b-268bda31316e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.480696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a1982-2d17-4224-8163-569a30486d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.481408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a1982-2d17-4224-8163-569a30486d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.485797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a1982-2d17-4224-8163-569a30486d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.491863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a1982-2d17-4224-8163-569a30486d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.491863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a1982-2d17-4224-8163-569a30486d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:05.491863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a1982-2d17-4224-8163-569a30486d77 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:05.513245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 867/1756] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:05.517771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe598c0a-12af-49be-a492-7acb9a8f7a03 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.544270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe598c0a-12af-49be-a492-7acb9a8f7a03 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.567438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20371c56-75ed-42ea-9bf1-9b0520802db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.568152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20371c56-75ed-42ea-9bf1-9b0520802db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.568431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20371c56-75ed-42ea-9bf1-9b0520802db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.568708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20371c56-75ed-42ea-9bf1-9b0520802db0 admin admin] PATH_INFO: `/v3/projects/33991e0fc6634ff7922b1a5b6f4352e7/users/fe711497b6434d4abe4f8de70046b4e8/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.619343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20371c56-75ed-42ea-9bf1-9b0520802db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33991e0fc6634ff7922b1a5b6f4352e7, user_id=fe711497b6434d4abe4f8de70046b4e8, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:05.634939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20371c56-75ed-42ea-9bf1-9b0520802db0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:05.763055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 890/1757] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:05 2022] PUT /identity/v3/projects/33991e0fc6634ff7922b1a5b6f4352e7/users/fe711497b6434d4abe4f8de70046b4e8/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:05.767488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a1982-2d17-4224-8163-569a30486d77 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.777945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a1982-2d17-4224-8163-569a30486d77 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.865696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a0432-7531-481d-a41e-28386b0b8d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.866480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0432-7531-481d-a41e-28386b0b8d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.866909 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0432-7531-481d-a41e-28386b0b8d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.877823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0432-7531-481d-a41e-28386b0b8d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.877823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0432-7531-481d-a41e-28386b0b8d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:05.882594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0432-7531-481d-a41e-28386b0b8d91 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:05.895863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 868/1758] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:05.897711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20371c56-75ed-42ea-9bf1-9b0520802db0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:05.911486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20371c56-75ed-42ea-9bf1-9b0520802db0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:05.916352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901efcd3-bf2e-4c2c-b2e7-01ab6fb1b4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:05.917010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efcd3-bf2e-4c2c-b2e7-01ab6fb1b4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.917293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efcd3-bf2e-4c2c-b2e7-01ab6fb1b4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.917599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901efcd3-bf2e-4c2c-b2e7-01ab6fb1b4f3 admin admin] PATH_INFO: `/v3/projects/33991e0fc6634ff7922b1a5b6f4352e7/users/fe711497b6434d4abe4f8de70046b4e8/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.919555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901efcd3-bf2e-4c2c-b2e7-01ab6fb1b4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33991e0fc6634ff7922b1a5b6f4352e7, user_id=fe711497b6434d4abe4f8de70046b4e8, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:05.922349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901efcd3-bf2e-4c2c-b2e7-01ab6fb1b4f3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:05.933929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 891/1759] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:05 2022] PUT /identity/v3/projects/33991e0fc6634ff7922b1a5b6f4352e7/users/fe711497b6434d4abe4f8de70046b4e8/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:05.951492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf965-cf6c-4636-bfe6-fba8804b79c0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:05.951721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf965-cf6c-4636-bfe6-fba8804b79c0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:05.952894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf965-cf6c-4636-bfe6-fba8804b79c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:05.984477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-45bbf965-cf6c-4636-bfe6-fba8804b79c0 None None] MFA Rules not processed for user `fe711497b6434d4abe4f8de70046b4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:05.985744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-45bbf965-cf6c-4636-bfe6-fba8804b79c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:06.083297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 869/1760] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:06.235604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5949112-07bb-4236-8533-74acab7b3c6b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.235927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5949112-07bb-4236-8533-74acab7b3c6b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.236205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5949112-07bb-4236-8533-74acab7b3c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.287004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d5949112-07bb-4236-8533-74acab7b3c6b None None] MFA Rules not processed for user `38a455340ad04762b886fccb8adcd8de`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:06.288293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d5949112-07bb-4236-8533-74acab7b3c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:06.327782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:06.389096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 892/1761] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:06 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:06.396981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf965-cf6c-4636-bfe6-fba8804b79c0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.398588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-45bbf965-cf6c-4636-bfe6-fba8804b79c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:06.531320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf965-cf6c-4636-bfe6-fba8804b79c0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.535872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e8eec-0b9c-4644-8420-98fb85a670cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.537150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8eec-0b9c-4644-8420-98fb85a670cf service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.537635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8eec-0b9c-4644-8420-98fb85a670cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.538214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8eec-0b9c-4644-8420-98fb85a670cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.552806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:06.555470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e8eec-0b9c-4644-8420-98fb85a670cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.557127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e8eec-0b9c-4644-8420-98fb85a670cf service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:06.572842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 870/1762] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:06.618954 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5949112-07bb-4236-8533-74acab7b3c6b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:06.818964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5949112-07bb-4236-8533-74acab7b3c6b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:06.834881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:06.835892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:06.836343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:06.836732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] PATH_INFO: `/v3/users/cace5d6d6c9e4f0b83297bb4e710e454` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:06.842048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cace5d6d6c9e4f0b83297bb4e710e454)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:06.842624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:07.172342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cace5d6d6c9e4f0b83297bb4e710e454'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:07.173147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cace5d6d6c9e4f0b83297bb4e710e454'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:07.309426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cace5d6d6c9e4f0b83297bb4e710e454'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:07.310053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cace5d6d6c9e4f0b83297bb4e710e454'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:07.327426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cace5d6d6c9e4f0b83297bb4e710e454'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:07.341198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 893/1763] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:06 2022] DELETE /identity/v3/users/cace5d6d6c9e4f0b83297bb4e710e454 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:07.346760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff0c5-7dbb-4f74-8fae-56102e90d9f9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.347300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff0c5-7dbb-4f74-8fae-56102e90d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.347406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff0c5-7dbb-4f74-8fae-56102e90d9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.374570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1e4ff0c5-7dbb-4f74-8fae-56102e90d9f9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:07.376002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1e4ff0c5-7dbb-4f74-8fae-56102e90d9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:07.448902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 871/1764] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:07.466998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:07.469102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:07.580511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ace8f1-fdad-4488-acc8-8e902147508f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.584434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ace8f1-fdad-4488-acc8-8e902147508f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.584550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055a8b2-4404-4040-8db1-113dbc7e76e9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:07.584652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ace8f1-fdad-4488-acc8-8e902147508f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.584652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 872/1765] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:21:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:07.589624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac83caa-e893-452a-b5bd-5ff62954cd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:07.590422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83caa-e893-452a-b5bd-5ff62954cd57 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.590699 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83caa-e893-452a-b5bd-5ff62954cd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.590970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83caa-e893-452a-b5bd-5ff62954cd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.604619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac83caa-e893-452a-b5bd-5ff62954cd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:07.606393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80204b1-e0bc-49df-8249-5b60b37bcc4d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.606393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80204b1-e0bc-49df-8249-5b60b37bcc4d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.606393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80204b1-e0bc-49df-8249-5b60b37bcc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.606737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac83caa-e893-452a-b5bd-5ff62954cd57 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:07.640479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 894/1766] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:07.649729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a80204b1-e0bc-49df-8249-5b60b37bcc4d None None] MFA Rules not processed for user `cacc0855973047b6a97e40b5f32a8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:07.651327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a80204b1-e0bc-49df-8249-5b60b37bcc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:07.777226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 873/1767] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:21:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:07.816589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eea66-27ce-40bc-a348-f65758392e4a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.820564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eea66-27ce-40bc-a348-f65758392e4a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.821039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eea66-27ce-40bc-a348-f65758392e4a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.826241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 895/1768] 10.222.0.13 () {54 vars in 961 bytes} [Wed Aug 31 11:21:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:07.839506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039034d8-9b80-4d3e-86c6-9fc463609563 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.839506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039034d8-9b80-4d3e-86c6-9fc463609563 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.839506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039034d8-9b80-4d3e-86c6-9fc463609563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.868633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-039034d8-9b80-4d3e-86c6-9fc463609563 None None] MFA Rules not processed for user `cacc0855973047b6a97e40b5f32a8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:07.875670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-039034d8-9b80-4d3e-86c6-9fc463609563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:07.884077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 874/1769] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Aug 31 11:21:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:07.894002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eea66-27ce-40bc-a348-f65758392e4a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:07.934419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eea66-27ce-40bc-a348-f65758392e4a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:07.941455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddefe82-0432-4b3b-961c-f97d5e4b6703 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:07.943448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddefe82-0432-4b3b-961c-f97d5e4b6703 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:07.944083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddefe82-0432-4b3b-961c-f97d5e4b6703 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:07.944555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddefe82-0432-4b3b-961c-f97d5e4b6703 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:07.957198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddefe82-0432-4b3b-961c-f97d5e4b6703 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:07.959030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddefe82-0432-4b3b-961c-f97d5e4b6703 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:07.993744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 896/1770] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:08.354617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039034d8-9b80-4d3e-86c6-9fc463609563 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:08.354617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-039034d8-9b80-4d3e-86c6-9fc463609563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:08.373529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039034d8-9b80-4d3e-86c6-9fc463609563 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:08.382290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:08.384468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.384468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.385029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] PATH_INFO: `/v3/projects/c168893038f64688a9fecd24d05eefe2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.387187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c168893038f64688a9fecd24d05eefe2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:08.392557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:08.622363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c168893038f64688a9fecd24d05eefe2', 'request_id': 'req-9d38e849-47ab-45f3-8cce-af3ce683e4c0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:08.640074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c168893038f64688a9fecd24d05eefe2', 'request_id': 'req-9d38e849-47ab-45f3-8cce-af3ce683e4c0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:08.755061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c168893038f64688a9fecd24d05eefe2', 'request_id': 'req-9d38e849-47ab-45f3-8cce-af3ce683e4c0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:08.771950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] The token cache is being invalidate because project c168893038f64688a9fecd24d05eefe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:08.772513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:08.773222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9d38e849-47ab-45f3-8cce-af3ce683e4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:08.775085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 875/1771] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:08 2022] DELETE /identity/v3/projects/c168893038f64688a9fecd24d05eefe2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:08.778934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddefe82-0432-4b3b-961c-f97d5e4b6703 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:08.797239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddefe82-0432-4b3b-961c-f97d5e4b6703 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:08.914542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:08.915192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:08.915474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:08.915940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] PATH_INFO: `/v3/users/fe711497b6434d4abe4f8de70046b4e8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:08.917170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe711497b6434d4abe4f8de70046b4e8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:08.920160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:09.137957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:09.193592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe711497b6434d4abe4f8de70046b4e8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:09.195431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe711497b6434d4abe4f8de70046b4e8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:09.280868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe711497b6434d4abe4f8de70046b4e8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:09.281505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe711497b6434d4abe4f8de70046b4e8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:09.300576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-070d4335-54dc-4a18-901f-f836246a4049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe711497b6434d4abe4f8de70046b4e8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:09.339659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 897/1772] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:08 2022] DELETE /identity/v3/users/fe711497b6434d4abe4f8de70046b4e8 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:09.512529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:09.798142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81ad84-358b-4872-8eea-9f9bc4ce6122 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.799294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81ad84-358b-4872-8eea-9f9bc4ce6122 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.799852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81ad84-358b-4872-8eea-9f9bc4ce6122 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.801511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 876/1773] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:09.863391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86081df-af95-48f9-8f36-a980be64ce49 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:09.863990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86081df-af95-48f9-8f36-a980be64ce49 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:09.864077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86081df-af95-48f9-8f36-a980be64ce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:09.914566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b86081df-af95-48f9-8f36-a980be64ce49 None None] MFA Rules not processed for user `cacc0855973047b6a97e40b5f32a8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:09.916146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b86081df-af95-48f9-8f36-a980be64ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:09.989679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:10.066240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81ad84-358b-4872-8eea-9f9bc4ce6122 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.069979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3a81ad84-358b-4872-8eea-9f9bc4ce6122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:10.119614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 898/1774] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:21:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:10.132580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86081df-af95-48f9-8f36-a980be64ce49 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.134118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b86081df-af95-48f9-8f36-a980be64ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:10.152740 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86081df-af95-48f9-8f36-a980be64ce49 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:10.172360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea723a3d-0d3b-43d0-8570-a83d701eeebe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:10.173141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723a3d-0d3b-43d0-8570-a83d701eeebe service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:10.173511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723a3d-0d3b-43d0-8570-a83d701eeebe service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:10.174083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723a3d-0d3b-43d0-8570-a83d701eeebe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:10.215983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81ad84-358b-4872-8eea-9f9bc4ce6122 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:10.224282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:10.225058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:10.225480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:10.225968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] PATH_INFO: `/v3/users/1d069ae0f4ce4b7086c360ddc098931b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:10.228180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d069ae0f4ce4b7086c360ddc098931b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:10.229377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea723a3d-0d3b-43d0-8570-a83d701eeebe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:10.230900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:10.231121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea723a3d-0d3b-43d0-8570-a83d701eeebe service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:10.284057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 899/1775] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:10.582519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d069ae0f4ce4b7086c360ddc098931b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:10.595140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d069ae0f4ce4b7086c360ddc098931b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:10.612979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d069ae0f4ce4b7086c360ddc098931b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:10.614385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d069ae0f4ce4b7086c360ddc098931b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:10.619482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d069ae0f4ce4b7086c360ddc098931b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:10.740251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea723a3d-0d3b-43d0-8570-a83d701eeebe service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.742052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ea723a3d-0d3b-43d0-8570-a83d701eeebe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:10.765914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea723a3d-0d3b-43d0-8570-a83d701eeebe service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:10.771109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:10.778704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:10.778989 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:10.779255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] PATH_INFO: `/v3/users/a0fe44914e19477e9b2230705f086609` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:10.781535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fe44914e19477e9b2230705f086609)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:10.783570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:10.827901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 877/1776] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:10 2022] DELETE /identity/v3/users/1d069ae0f4ce4b7086c360ddc098931b => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:10.831422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:10.833902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.005711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f8a19-a90b-42d1-ad08-a940f8346e16 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:11.013985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:11.015587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.016058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.016490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] PATH_INFO: `/v3/projects/33991e0fc6634ff7922b1a5b6f4352e7` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.017232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fe44914e19477e9b2230705f086609'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.020512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fe44914e19477e9b2230705f086609'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.035543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33991e0fc6634ff7922b1a5b6f4352e7)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:11.045354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:11.132506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fe44914e19477e9b2230705f086609'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.133594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fe44914e19477e9b2230705f086609'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.157164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b46d2bdb-a140-4fd1-a3e5-dcfc156e5bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fe44914e19477e9b2230705f086609'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.196978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 900/1777] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:10 2022] DELETE /identity/v3/users/a0fe44914e19477e9b2230705f086609 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:11.196978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ed0e5-140b-4ba2-9a6f-04104f881c8d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.196978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ed0e5-140b-4ba2-9a6f-04104f881c8d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.196978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ed0e5-140b-4ba2-9a6f-04104f881c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.226333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-655ed0e5-140b-4ba2-9a6f-04104f881c8d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:11.227882 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-655ed0e5-140b-4ba2-9a6f-04104f881c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.261688 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33991e0fc6634ff7922b1a5b6f4352e7', 'request_id': 'req-eaa48da6-5df9-48c6-b566-c89d36ee8212'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.287220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33991e0fc6634ff7922b1a5b6f4352e7', 'request_id': 'req-eaa48da6-5df9-48c6-b566-c89d36ee8212'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.384462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33991e0fc6634ff7922b1a5b6f4352e7', 'request_id': 'req-eaa48da6-5df9-48c6-b566-c89d36ee8212'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.397168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 901/1778] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:11.398692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ed0e5-140b-4ba2-9a6f-04104f881c8d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:11.400444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-655ed0e5-140b-4ba2-9a6f-04104f881c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.416155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] The token cache is being invalidate because project 33991e0fc6634ff7922b1a5b6f4352e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:11.416465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ed0e5-140b-4ba2-9a6f-04104f881c8d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:11.417080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.418555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.421750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 878/1779] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:10 2022] DELETE /identity/v3/projects/33991e0fc6634ff7922b1a5b6f4352e7 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:11.426073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:11.426073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.554020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:11.582092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:11.582997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.583683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.584204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] PATH_INFO: `/v3/projects/902f2a168a9d48dd8bff326fdddd297a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.586819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902f2a168a9d48dd8bff326fdddd297a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:11.589466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:11.625770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa48da6-5df9-48c6-b566-c89d36ee8212 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:11.650392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961c544-7ccb-418e-bd38-76772777e1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:11.651074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961c544-7ccb-418e-bd38-76772777e1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.651554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961c544-7ccb-418e-bd38-76772777e1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.651879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961c544-7ccb-418e-bd38-76772777e1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.654205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f961c544-7ccb-418e-bd38-76772777e1b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.669217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961c544-7ccb-418e-bd38-76772777e1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:11.673930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961c544-7ccb-418e-bd38-76772777e1b8 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:11.685718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 879/1780] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:11.689628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47e02-bd56-4fa4-8375-2c98b7275343 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.690459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47e02-bd56-4fa4-8375-2c98b7275343 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.691126 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea47e02-bd56-4fa4-8375-2c98b7275343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.734451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2ea47e02-bd56-4fa4-8375-2c98b7275343 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:11.736126 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2ea47e02-bd56-4fa4-8375-2c98b7275343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.795680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902f2a168a9d48dd8bff326fdddd297a', 'request_id': 'req-30de9acf-55cf-4583-a5ef-134b05324616'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.805657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902f2a168a9d48dd8bff326fdddd297a', 'request_id': 'req-30de9acf-55cf-4583-a5ef-134b05324616'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.819514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902f2a168a9d48dd8bff326fdddd297a', 'request_id': 'req-30de9acf-55cf-4583-a5ef-134b05324616'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.903614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 880/1781] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:11.906171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66c4f-cf66-4b50-95d4-6d27d292078e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.906683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66c4f-cf66-4b50-95d4-6d27d292078e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.907074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66c4f-cf66-4b50-95d4-6d27d292078e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.912093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] The token cache is being invalidate because project 902f2a168a9d48dd8bff326fdddd297a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:11.913116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.915241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:11.920341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 902/1782] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:11 2022] DELETE /identity/v3/projects/902f2a168a9d48dd8bff326fdddd297a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:11.925317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:11.929859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.941769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-63c66c4f-cf66-4b50-95d4-6d27d292078e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:11.941769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-63c66c4f-cf66-4b50-95d4-6d27d292078e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:11.947576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de9acf-55cf-4583-a5ef-134b05324616 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:11.953316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:11.956223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:11.956223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:11.956223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] PATH_INFO: `/v3/users/38a455340ad04762b886fccb8adcd8de` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:11.956520 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a455340ad04762b886fccb8adcd8de)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:11.960552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:11.970747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 881/1783] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:11.975838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c66c4f-cf66-4b50-95d4-6d27d292078e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:11.997253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c66c4f-cf66-4b50-95d4-6d27d292078e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.011774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c7dd4-3803-431c-ba91-204b55200baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.013467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c7dd4-3803-431c-ba91-204b55200baf admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.013759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c7dd4-3803-431c-ba91-204b55200baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.014378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c7dd4-3803-431c-ba91-204b55200baf admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.016079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c7dd4-3803-431c-ba91-204b55200baf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:12.016593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c7dd4-3803-431c-ba91-204b55200baf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.019613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c7dd4-3803-431c-ba91-204b55200baf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.045186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 882/1784] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:12.051324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c7dd4-3803-431c-ba91-204b55200baf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.096078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c7dd4-3803-431c-ba91-204b55200baf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.101975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4045432-64dc-48a8-8dcf-c6a9740a313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.103108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4045432-64dc-48a8-8dcf-c6a9740a313a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.103423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4045432-64dc-48a8-8dcf-c6a9740a313a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.103953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4045432-64dc-48a8-8dcf-c6a9740a313a admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.104747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4045432-64dc-48a8-8dcf-c6a9740a313a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.107047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4045432-64dc-48a8-8dcf-c6a9740a313a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.182028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a455340ad04762b886fccb8adcd8de'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:12.183355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a455340ad04762b886fccb8adcd8de'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:12.261280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 883/1785] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:12 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:12.264134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4045432-64dc-48a8-8dcf-c6a9740a313a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.275471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a455340ad04762b886fccb8adcd8de'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:12.276200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a455340ad04762b886fccb8adcd8de'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:12.295435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a455340ad04762b886fccb8adcd8de'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:12.331200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 903/1786] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:11 2022] DELETE /identity/v3/users/38a455340ad04762b886fccb8adcd8de => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:12.418864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4045432-64dc-48a8-8dcf-c6a9740a313a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.539342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a11e-c589-4717-a08e-d1d2fea881f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.539682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a11e-c589-4717-a08e-d1d2fea881f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.540090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a11e-c589-4717-a08e-d1d2fea881f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.540432 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a11e-c589-4717-a08e-d1d2fea881f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.541225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a11e-c589-4717-a08e-d1d2fea881f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.543969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a11e-c589-4717-a08e-d1d2fea881f6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.654590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 884/1787] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:12 2022] POST /identity/v3/users => generated 294 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:12.659245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.661758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:12.676892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefabb00-d0eb-4101-b380-a3ea989cf6c2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.683802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112f7e6-564e-4f17-8c7b-f2ff90c0b2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.684443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112f7e6-564e-4f17-8c7b-f2ff90c0b2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.685440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112f7e6-564e-4f17-8c7b-f2ff90c0b2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.687330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112f7e6-564e-4f17-8c7b-f2ff90c0b2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.688029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112f7e6-564e-4f17-8c7b-f2ff90c0b2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.689617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112f7e6-564e-4f17-8c7b-f2ff90c0b2c7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.702487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 904/1788] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:12.704210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a11e-c589-4717-a08e-d1d2fea881f6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.714277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a11e-c589-4717-a08e-d1d2fea881f6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.719404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb77a-a2d0-4607-9e62-8af95888eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.720062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb77a-a2d0-4607-9e62-8af95888eb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.720339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb77a-a2d0-4607-9e62-8af95888eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.720611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb77a-a2d0-4607-9e62-8af95888eb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.721294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cb77a-a2d0-4607-9e62-8af95888eb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.722837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cb77a-a2d0-4607-9e62-8af95888eb6a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.728917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112f7e6-564e-4f17-8c7b-f2ff90c0b2c7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.730746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2112f7e6-564e-4f17-8c7b-f2ff90c0b2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:12.735859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 885/1789] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:21:12.740059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb77a-a2d0-4607-9e62-8af95888eb6a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.771182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112f7e6-564e-4f17-8c7b-f2ff90c0b2c7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.779329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.780761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.780961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb77a-a2d0-4607-9e62-8af95888eb6a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:12.781148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.781429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] PATH_INFO: `/v3/projects/2107e4f7dae74ae2aaf4c1f6f98d07c7` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.782727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2107e4f7dae74ae2aaf4c1f6f98d07c7)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.785176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.801720 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86202ef-0d58-4d8e-9dbb-0ca517769f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:12.802404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86202ef-0d58-4d8e-9dbb-0ca517769f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:12.802722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86202ef-0d58-4d8e-9dbb-0ca517769f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:12.803199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86202ef-0d58-4d8e-9dbb-0ca517769f04 admin admin] PATH_INFO: `/v3/projects/5581e8454f81443196bb75c53fb8153b/users/fe326e3e7b0747aa8b25c427ec9fb99f/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:12.824041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86202ef-0d58-4d8e-9dbb-0ca517769f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5581e8454f81443196bb75c53fb8153b, user_id=fe326e3e7b0747aa8b25c427ec9fb99f, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:12.826881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86202ef-0d58-4d8e-9dbb-0ca517769f04 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:12.833760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:12.928863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 886/1790] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:12 2022] PUT /identity/v3/projects/5581e8454f81443196bb75c53fb8153b/users/fe326e3e7b0747aa8b25c427ec9fb99f/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:12.931923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86202ef-0d58-4d8e-9dbb-0ca517769f04 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:12.931923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b86202ef-0d58-4d8e-9dbb-0ca517769f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:12.952282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2107e4f7dae74ae2aaf4c1f6f98d07c7', 'request_id': 'req-f094dd97-e018-4aa4-902b-2db427942781'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:12.960187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2107e4f7dae74ae2aaf4c1f6f98d07c7', 'request_id': 'req-f094dd97-e018-4aa4-902b-2db427942781'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:12.965863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2107e4f7dae74ae2aaf4c1f6f98d07c7', 'request_id': 'req-f094dd97-e018-4aa4-902b-2db427942781'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.014517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86202ef-0d58-4d8e-9dbb-0ca517769f04 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:13.079587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:13.080279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.080559 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.080832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] PATH_INFO: `/v3/projects/63cb7a1637a749978431415c69b5b695` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.081959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cb7a1637a749978431415c69b5b695)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:13.083928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:13.098161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] The token cache is being invalidate because project 2107e4f7dae74ae2aaf4c1f6f98d07c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:13.103735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.103735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f094dd97-e018-4aa4-902b-2db427942781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.103735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 905/1791] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:12 2022] DELETE /identity/v3/projects/2107e4f7dae74ae2aaf4c1f6f98d07c7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:13.103735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c062c-9de7-46c4-afaf-0c25fb508439 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.103735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c062c-9de7-46c4-afaf-0c25fb508439 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.103735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c062c-9de7-46c4-afaf-0c25fb508439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.136879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1d7c062c-9de7-46c4-afaf-0c25fb508439 None None] MFA Rules not processed for user `fe326e3e7b0747aa8b25c427ec9fb99f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:13.138852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1d7c062c-9de7-46c4-afaf-0c25fb508439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:13.207656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:13.224385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 906/1792] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:13.225437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c062c-9de7-46c4-afaf-0c25fb508439 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:13.226939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1d7c062c-9de7-46c4-afaf-0c25fb508439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:13.232809 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cb7a1637a749978431415c69b5b695', 'request_id': 'req-2bd568e8-67b3-4b88-afd1-ce343757f6e8'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.241516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cb7a1637a749978431415c69b5b695', 'request_id': 'req-2bd568e8-67b3-4b88-afd1-ce343757f6e8'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.251137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c062c-9de7-46c4-afaf-0c25fb508439 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:13.349403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cb7a1637a749978431415c69b5b695', 'request_id': 'req-2bd568e8-67b3-4b88-afd1-ce343757f6e8'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.362605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] The token cache is being invalidate because project 63cb7a1637a749978431415c69b5b695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:13.362870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.363556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.364884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:13.365698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.366056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.366337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] PATH_INFO: `/v3/users/c8326ee829e4426aaf24cc651a2380c9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.367594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8326ee829e4426aaf24cc651a2380c9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:13.368746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 887/1793] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:12 2022] DELETE /identity/v3/projects/63cb7a1637a749978431415c69b5b695 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:13.369986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:13.370184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:13.371213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:13.390812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd568e8-67b3-4b88-afd1-ce343757f6e8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:13.395965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958084fc-d45d-4bb4-a8cc-c81c34d61655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:13.396577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958084fc-d45d-4bb4-a8cc-c81c34d61655 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.396856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958084fc-d45d-4bb4-a8cc-c81c34d61655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.397126 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958084fc-d45d-4bb4-a8cc-c81c34d61655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.397762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958084fc-d45d-4bb4-a8cc-c81c34d61655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:13.399864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958084fc-d45d-4bb4-a8cc-c81c34d61655 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:13.494244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 888/1794] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:13 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:13.495568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e887-46ac-49ed-abab-2cd4d1e371cb None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.495883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e887-46ac-49ed-abab-2cd4d1e371cb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.496249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e887-46ac-49ed-abab-2cd4d1e371cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.515133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b4d2e887-46ac-49ed-abab-2cd4d1e371cb None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:13.516360 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b4d2e887-46ac-49ed-abab-2cd4d1e371cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:13.575408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 889/1795] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:13.576453 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2e887-46ac-49ed-abab-2cd4d1e371cb None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:13.586342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2e887-46ac-49ed-abab-2cd4d1e371cb None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:13.590987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be342b-1b80-4bce-aa9e-9e2e5e6c0220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:13.591584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be342b-1b80-4bce-aa9e-9e2e5e6c0220 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.591904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be342b-1b80-4bce-aa9e-9e2e5e6c0220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.592181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be342b-1b80-4bce-aa9e-9e2e5e6c0220 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.593516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be342b-1b80-4bce-aa9e-9e2e5e6c0220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:13.595427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be342b-1b80-4bce-aa9e-9e2e5e6c0220 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:13.625140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8326ee829e4426aaf24cc651a2380c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.625794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8326ee829e4426aaf24cc651a2380c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.715240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 890/1796] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:13 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:13.716918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375356f-75dc-493a-9272-872a380790b2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.718042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375356f-75dc-493a-9272-872a380790b2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.718500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375356f-75dc-493a-9272-872a380790b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.738988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c375356f-75dc-493a-9272-872a380790b2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:13.740226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c375356f-75dc-493a-9272-872a380790b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:13.744167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8326ee829e4426aaf24cc651a2380c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.744879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8326ee829e4426aaf24cc651a2380c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.749754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 891/1797] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:13.750777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375356f-75dc-493a-9272-872a380790b2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:13.752097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c375356f-75dc-493a-9272-872a380790b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:13.763319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8326ee829e4426aaf24cc651a2380c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:13.766214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375356f-75dc-493a-9272-872a380790b2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:13.770915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442abfa-2f91-4092-bee1-ff8a4233fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:13.771630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442abfa-2f91-4092-bee1-ff8a4233fe70 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.771997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442abfa-2f91-4092-bee1-ff8a4233fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.772335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442abfa-2f91-4092-bee1-ff8a4233fe70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.773073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442abfa-2f91-4092-bee1-ff8a4233fe70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:13.774790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442abfa-2f91-4092-bee1-ff8a4233fe70 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:13.778090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 907/1798] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:13 2022] DELETE /identity/v3/users/c8326ee829e4426aaf24cc651a2380c9 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:13.779004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:13.794512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 892/1799] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:13.805063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442abfa-2f91-4092-bee1-ff8a4233fe70 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:13.809071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442abfa-2f91-4092-bee1-ff8a4233fe70 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:13.870767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d6491-2918-4643-9db4-38c03befd407 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:13.880621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc188-4380-4ece-b915-600f2894c3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:13.881043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e67a8d-5889-4487-a8d8-d336d42769cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:13.881523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc188-4380-4ece-b915-600f2894c3ac admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.881809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc188-4380-4ece-b915-600f2894c3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.882079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e67a8d-5889-4487-a8d8-d336d42769cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.882186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdc188-4380-4ece-b915-600f2894c3ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.882537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e67a8d-5889-4487-a8d8-d336d42769cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.882936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e67a8d-5889-4487-a8d8-d336d42769cd admin admin] PATH_INFO: `/v3/projects/b81ee4fd15b5471698ba291e3ec5ae49/users/b239fe4f98c241b9b07800770afad4d1/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.883391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdc188-4380-4ece-b915-600f2894c3ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:13.883701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdc188-4380-4ece-b915-600f2894c3ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:13.885856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdc188-4380-4ece-b915-600f2894c3ac admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:13.904872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 908/1800] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:13.905211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e67a8d-5889-4487-a8d8-d336d42769cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81ee4fd15b5471698ba291e3ec5ae49, user_id=b239fe4f98c241b9b07800770afad4d1, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:13.905676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e67a8d-5889-4487-a8d8-d336d42769cd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:13.920115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc188-4380-4ece-b915-600f2894c3ac admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:13.928945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdc188-4380-4ece-b915-600f2894c3ac admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:13.933811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c118a-2737-4caa-8304-1ef075e39510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:13.934486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c118a-2737-4caa-8304-1ef075e39510 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:13.934826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c118a-2737-4caa-8304-1ef075e39510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:13.935161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c118a-2737-4caa-8304-1ef075e39510 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:13.935904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c118a-2737-4caa-8304-1ef075e39510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:13.938740 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c118a-2737-4caa-8304-1ef075e39510 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:13.995172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 893/1801] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:13 2022] PUT /identity/v3/projects/b81ee4fd15b5471698ba291e3ec5ae49/users/b239fe4f98c241b9b07800770afad4d1/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:14.001190 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e67a8d-5889-4487-a8d8-d336d42769cd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:14.052305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 909/1802] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:13 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:14.053375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c118a-2737-4caa-8304-1ef075e39510 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:14.069263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e67a8d-5889-4487-a8d8-d336d42769cd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:14.137199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c118a-2737-4caa-8304-1ef075e39510 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:14.142167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07711f1e-3e30-4ebc-b1ef-93b24c3415e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:14.143017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07711f1e-3e30-4ebc-b1ef-93b24c3415e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.143572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07711f1e-3e30-4ebc-b1ef-93b24c3415e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.144064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07711f1e-3e30-4ebc-b1ef-93b24c3415e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.144907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07711f1e-3e30-4ebc-b1ef-93b24c3415e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:14.147521 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07711f1e-3e30-4ebc-b1ef-93b24c3415e7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:14.152981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ec467-3edd-4196-b65d-a82145862baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:14.153873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ec467-3edd-4196-b65d-a82145862baf admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.154328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ec467-3edd-4196-b65d-a82145862baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.154603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ec467-3edd-4196-b65d-a82145862baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.156649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ec467-3edd-4196-b65d-a82145862baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:14.158931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ec467-3edd-4196-b65d-a82145862baf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:14.174596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 894/1803] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:21:14.178817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ec467-3edd-4196-b65d-a82145862baf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:14.190428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ec467-3edd-4196-b65d-a82145862baf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:14.195309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb5464-ea48-404b-8fb4-8492337a0222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:14.196091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb5464-ea48-404b-8fb4-8492337a0222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.196441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb5464-ea48-404b-8fb4-8492337a0222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.196782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb5464-ea48-404b-8fb4-8492337a0222 admin admin] PATH_INFO: `/v3/projects/b81ee4fd15b5471698ba291e3ec5ae49/users/b239fe4f98c241b9b07800770afad4d1/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.199090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb5464-ea48-404b-8fb4-8492337a0222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81ee4fd15b5471698ba291e3ec5ae49, user_id=b239fe4f98c241b9b07800770afad4d1, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:14.201950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb5464-ea48-404b-8fb4-8492337a0222 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:14.220271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 895/1804] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:14 2022] PUT /identity/v3/projects/b81ee4fd15b5471698ba291e3ec5ae49/users/b239fe4f98c241b9b07800770afad4d1/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:14.232341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb5464-ea48-404b-8fb4-8492337a0222 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:14.235287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-afbb5464-ea48-404b-8fb4-8492337a0222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:14.291392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 910/1805] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:14 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:14.293566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd1293-56bf-495e-bf1f-9ba5c0dca456 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.293993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd1293-56bf-495e-bf1f-9ba5c0dca456 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.294530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd1293-56bf-495e-bf1f-9ba5c0dca456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.316519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb5464-ea48-404b-8fb4-8492337a0222 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:14.324630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:14.325965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.326350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.327006 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] PATH_INFO: `/v3/users/bfb506fba9c24c388584fa4a5e14374c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.328012 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb506fba9c24c388584fa4a5e14374c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:14.330149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:14.332702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-86fd1293-56bf-495e-bf1f-9ba5c0dca456 None None] MFA Rules not processed for user `b239fe4f98c241b9b07800770afad4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:14.338498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-86fd1293-56bf-495e-bf1f-9ba5c0dca456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:14.443849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 911/1806] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:14.450715 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd1293-56bf-495e-bf1f-9ba5c0dca456 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:14.466155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd1293-56bf-495e-bf1f-9ba5c0dca456 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:14.477459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105da826-2c2f-4c5d-85b4-c7f76058111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:14.477459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105da826-2c2f-4c5d-85b4-c7f76058111d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.477459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105da826-2c2f-4c5d-85b4-c7f76058111d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.477459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105da826-2c2f-4c5d-85b4-c7f76058111d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.477815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105da826-2c2f-4c5d-85b4-c7f76058111d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:14.477815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105da826-2c2f-4c5d-85b4-c7f76058111d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:14.486627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 912/1807] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:14.487545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105da826-2c2f-4c5d-85b4-c7f76058111d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:14.489535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-105da826-2c2f-4c5d-85b4-c7f76058111d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:14.503849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105da826-2c2f-4c5d-85b4-c7f76058111d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:14.508950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:14.509581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.509856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.510243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] PATH_INFO: `/v3/projects/e8526db9cb024360866d843f93334923` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.511362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8526db9cb024360866d843f93334923)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:14.513338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:14.569989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb506fba9c24c388584fa4a5e14374c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.577367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb506fba9c24c388584fa4a5e14374c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.589270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb506fba9c24c388584fa4a5e14374c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.589986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb506fba9c24c388584fa4a5e14374c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.596345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb506fba9c24c388584fa4a5e14374c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.652353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:14.669345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8526db9cb024360866d843f93334923', 'request_id': 'req-c6edb70e-562f-4f61-9678-f441745f3d28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.675890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8526db9cb024360866d843f93334923', 'request_id': 'req-c6edb70e-562f-4f61-9678-f441745f3d28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.681507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8526db9cb024360866d843f93334923', 'request_id': 'req-c6edb70e-562f-4f61-9678-f441745f3d28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.713980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 896/1808] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:14 2022] DELETE /identity/v3/users/bfb506fba9c24c388584fa4a5e14374c => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:14.714819 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:14.716282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:14.777584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b53824-e546-42b8-95ff-49ee53a9f64d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:14.781986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f4c5b-f62a-41b7-9c81-96e5530d5590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:14.782596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f4c5b-f62a-41b7-9c81-96e5530d5590 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.782874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f4c5b-f62a-41b7-9c81-96e5530d5590 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.783145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f4c5b-f62a-41b7-9c81-96e5530d5590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.784897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a03f4c5b-f62a-41b7-9c81-96e5530d5590 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:14.794912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] The token cache is being invalidate because project e8526db9cb024360866d843f93334923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:14.795196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.796058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:14.797823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 913/1809] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:14 2022] DELETE /identity/v3/projects/e8526db9cb024360866d843f93334923 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:14.800595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:14.800595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:14.853541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f4c5b-f62a-41b7-9c81-96e5530d5590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:14.854977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f4c5b-f62a-41b7-9c81-96e5530d5590 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:14.862717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:14.869611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 897/1810] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:14.869611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015afd4-5cf9-48ae-9f8f-2a9556efc2ff None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.869611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015afd4-5cf9-48ae-9f8f-2a9556efc2ff None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.869611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015afd4-5cf9-48ae-9f8f-2a9556efc2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.870495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb70e-562f-4f61-9678-f441745f3d28 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:14.888808 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0015afd4-5cf9-48ae-9f8f-2a9556efc2ff None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:14.892294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0015afd4-5cf9-48ae-9f8f-2a9556efc2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:14.941373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6820e-ee09-49f5-9e6e-42b1526bf566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:14.942001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6820e-ee09-49f5-9e6e-42b1526bf566 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.942458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6820e-ee09-49f5-9e6e-42b1526bf566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.943246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6820e-ee09-49f5-9e6e-42b1526bf566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.944364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6820e-ee09-49f5-9e6e-42b1526bf566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:14.946285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6820e-ee09-49f5-9e6e-42b1526bf566 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:14.963218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 914/1811] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:14.964634 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a332c-81aa-401e-8091-0809c41db75d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:14.965070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a332c-81aa-401e-8091-0809c41db75d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:14.965363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a332c-81aa-401e-8091-0809c41db75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:14.993748 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 898/1812] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:14.994242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015afd4-5cf9-48ae-9f8f-2a9556efc2ff None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.004996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015afd4-5cf9-48ae-9f8f-2a9556efc2ff None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.012013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7e7a332c-81aa-401e-8091-0809c41db75d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:15.013235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7e7a332c-81aa-401e-8091-0809c41db75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.015926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae825ad-e004-4839-b298-b203b98a8e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.017001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae825ad-e004-4839-b298-b203b98a8e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.017430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae825ad-e004-4839-b298-b203b98a8e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.017849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae825ad-e004-4839-b298-b203b98a8e68 admin admin] PATH_INFO: `/v3/projects/a1de7ca8c8f34c5eaa1591caeb61c8b8/users/2c6775e434ef4b3aa6f08bc64c846077/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.023085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 915/1813] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:15.026000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a332c-81aa-401e-8091-0809c41db75d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.026000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7e7a332c-81aa-401e-8091-0809c41db75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.038521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae825ad-e004-4839-b298-b203b98a8e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1de7ca8c8f34c5eaa1591caeb61c8b8, user_id=2c6775e434ef4b3aa6f08bc64c846077, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.042262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae825ad-e004-4839-b298-b203b98a8e68 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.097807 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a332c-81aa-401e-8091-0809c41db75d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.101387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510ae5c-2824-4312-88ee-a6ed861f52b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.101985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510ae5c-2824-4312-88ee-a6ed861f52b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.102258 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510ae5c-2824-4312-88ee-a6ed861f52b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.102528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510ae5c-2824-4312-88ee-a6ed861f52b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.111607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510ae5c-2824-4312-88ee-a6ed861f52b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.113060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510ae5c-2824-4312-88ee-a6ed861f52b5 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.115609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 899/1814] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:14 2022] PUT /identity/v3/projects/a1de7ca8c8f34c5eaa1591caeb61c8b8/users/2c6775e434ef4b3aa6f08bc64c846077/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:15.122732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 916/1815] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:15.124094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510ae5c-2824-4312-88ee-a6ed861f52b5 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.125503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e510ae5c-2824-4312-88ee-a6ed861f52b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.128612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:15.129343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4391dd-d73a-4539-998c-3aec66eea952 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.129836 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4391dd-d73a-4539-998c-3aec66eea952 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.130215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4391dd-d73a-4539-998c-3aec66eea952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.138605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510ae5c-2824-4312-88ee-a6ed861f52b5 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.152282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4d4391dd-d73a-4539-998c-3aec66eea952 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:15.153643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4d4391dd-d73a-4539-998c-3aec66eea952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.209165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.209812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.210091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.210373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] PATH_INFO: `/v3/users/fe326e3e7b0747aa8b25c427ec9fb99f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.211553 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe326e3e7b0747aa8b25c427ec9fb99f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.213755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.228188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 900/1816] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:15.229375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0413-7888-4e98-a850-8588d8ed137b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.229665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0413-7888-4e98-a850-8588d8ed137b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.229940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0413-7888-4e98-a850-8588d8ed137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.258596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5cce0413-7888-4e98-a850-8588d8ed137b None None] MFA Rules not processed for user `2c6775e434ef4b3aa6f08bc64c846077`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:15.259842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5cce0413-7888-4e98-a850-8588d8ed137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.327193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 901/1817] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:15.327193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0413-7888-4e98-a850-8588d8ed137b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.337762 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0413-7888-4e98-a850-8588d8ed137b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.343378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e438e36-09e3-4cd3-a65f-5f684fb41c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.344077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438e36-09e3-4cd3-a65f-5f684fb41c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.344366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438e36-09e3-4cd3-a65f-5f684fb41c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.344646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438e36-09e3-4cd3-a65f-5f684fb41c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.345318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e438e36-09e3-4cd3-a65f-5f684fb41c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:15.345628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e438e36-09e3-4cd3-a65f-5f684fb41c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.347378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e438e36-09e3-4cd3-a65f-5f684fb41c0f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.364270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 902/1818] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:15.364270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e438e36-09e3-4cd3-a65f-5f684fb41c0f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.372488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e438e36-09e3-4cd3-a65f-5f684fb41c0f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.378939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7df79-ec70-46ef-bc84-91036592311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.379787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7df79-ec70-46ef-bc84-91036592311b admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.380078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7df79-ec70-46ef-bc84-91036592311b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.380693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7df79-ec70-46ef-bc84-91036592311b admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.381412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7df79-ec70-46ef-bc84-91036592311b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.383955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7df79-ec70-46ef-bc84-91036592311b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.440458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe326e3e7b0747aa8b25c427ec9fb99f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:15.441921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe326e3e7b0747aa8b25c427ec9fb99f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:15.517558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 903/1819] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:15 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:15.518605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7df79-ec70-46ef-bc84-91036592311b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.546107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe326e3e7b0747aa8b25c427ec9fb99f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:15.547037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe326e3e7b0747aa8b25c427ec9fb99f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:15.563688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe326e3e7b0747aa8b25c427ec9fb99f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:15.579119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 917/1820] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:15 2022] DELETE /identity/v3/users/fe326e3e7b0747aa8b25c427ec9fb99f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:15.580085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.581692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.606364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7df79-ec70-46ef-bc84-91036592311b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.685254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d61ac-c1fe-49cc-a25c-6b42670b7a49 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.693547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90bc60-72a4-42c7-9cd9-895e7532580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.694307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90bc60-72a4-42c7-9cd9-895e7532580e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.694727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90bc60-72a4-42c7-9cd9-895e7532580e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.695014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90bc60-72a4-42c7-9cd9-895e7532580e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.695654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90bc60-72a4-42c7-9cd9-895e7532580e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.697899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90bc60-72a4-42c7-9cd9-895e7532580e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.705732 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9261bf-66be-4894-8e69-08641977d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.707531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9261bf-66be-4894-8e69-08641977d971 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.707531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9261bf-66be-4894-8e69-08641977d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.707813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9261bf-66be-4894-8e69-08641977d971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.708620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9261bf-66be-4894-8e69-08641977d971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.710759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9261bf-66be-4894-8e69-08641977d971 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.773884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 918/1821] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:15 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:15.775350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b86fd-a1f9-430b-b964-b5bd645ac61e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.777433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b86fd-a1f9-430b-b964-b5bd645ac61e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.777433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b86fd-a1f9-430b-b964-b5bd645ac61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.807384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-647b86fd-a1f9-430b-b964-b5bd645ac61e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:15.808777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-647b86fd-a1f9-430b-b964-b5bd645ac61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.817777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 919/1822] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:15.818604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b86fd-a1f9-430b-b964-b5bd645ac61e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.820023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-647b86fd-a1f9-430b-b964-b5bd645ac61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.832543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b86fd-a1f9-430b-b964-b5bd645ac61e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.837214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.837844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.838129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.838433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] PATH_INFO: `/v3/projects/26c04491d7e54bb1b8f5e8b66da80af3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.839672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c04491d7e54bb1b8f5e8b66da80af3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.841653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.860640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 904/1823] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:15 2022] POST /identity/v3/projects => generated 385 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:15.861513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9261bf-66be-4894-8e69-08641977d971 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.926748 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9261bf-66be-4894-8e69-08641977d971 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:15.931703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037f4b5-38fd-47d6-954c-416967aaf7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:15.932342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037f4b5-38fd-47d6-954c-416967aaf7de admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:15.932624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037f4b5-38fd-47d6-954c-416967aaf7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:15.932897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037f4b5-38fd-47d6-954c-416967aaf7de admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:15.933542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037f4b5-38fd-47d6-954c-416967aaf7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:15.935137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037f4b5-38fd-47d6-954c-416967aaf7de admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:15.946193 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 905/1824] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:15.947172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037f4b5-38fd-47d6-954c-416967aaf7de admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:15.950447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6037f4b5-38fd-47d6-954c-416967aaf7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:15.992951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c04491d7e54bb1b8f5e8b66da80af3', 'request_id': 'req-9b5ad628-2862-4d19-b2be-0923bc8bb385'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:15.999922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c04491d7e54bb1b8f5e8b66da80af3', 'request_id': 'req-9b5ad628-2862-4d19-b2be-0923bc8bb385'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:16.005990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c04491d7e54bb1b8f5e8b66da80af3', 'request_id': 'req-9b5ad628-2862-4d19-b2be-0923bc8bb385'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:16.010297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037f4b5-38fd-47d6-954c-416967aaf7de admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.060865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66db13-317c-4107-919c-36dc6be98ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.061363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66db13-317c-4107-919c-36dc6be98ede service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.061667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66db13-317c-4107-919c-36dc6be98ede service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.061909 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66db13-317c-4107-919c-36dc6be98ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.092266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] The token cache is being invalidate because project 26c04491d7e54bb1b8f5e8b66da80af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:16.093285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:16.096077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:16.100181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 920/1825] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:15 2022] DELETE /identity/v3/projects/26c04491d7e54bb1b8f5e8b66da80af3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:16.110398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.120572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:16.139389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66db13-317c-4107-919c-36dc6be98ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.141344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66db13-317c-4107-919c-36dc6be98ede service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.155284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 906/1826] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:16.166648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66db13-317c-4107-919c-36dc6be98ede service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.184707 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66db13-317c-4107-919c-36dc6be98ede service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.200472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f2f5b-46b4-4f2b-9823-82bda09b7e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.202816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2f5b-46b4-4f2b-9823-82bda09b7e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.203202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2f5b-46b4-4f2b-9823-82bda09b7e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.203573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2f5b-46b4-4f2b-9823-82bda09b7e58 admin admin] PATH_INFO: `/v3/projects/e8ef216619ed4bc4b2bfd58f755906ee/users/97a358414fc84858a1d0d42e1cdf9a79/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.235623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f2f5b-46b4-4f2b-9823-82bda09b7e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ef216619ed4bc4b2bfd58f755906ee, user_id=97a358414fc84858a1d0d42e1cdf9a79, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.244407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f2f5b-46b4-4f2b-9823-82bda09b7e58 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.246520 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ad628-2862-4d19-b2be-0923bc8bb385 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.257452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d13e6-f39a-4c2d-8c7e-e67a5d596cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.258104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d13e6-f39a-4c2d-8c7e-e67a5d596cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.258387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d13e6-f39a-4c2d-8c7e-e67a5d596cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.258665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d13e6-f39a-4c2d-8c7e-e67a5d596cdc admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.259369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d13e6-f39a-4c2d-8c7e-e67a5d596cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.262723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d13e6-f39a-4c2d-8c7e-e67a5d596cdc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.355599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 907/1827] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:16 2022] PUT /identity/v3/projects/e8ef216619ed4bc4b2bfd58f755906ee/users/97a358414fc84858a1d0d42e1cdf9a79/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:16.358541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a686b-58fe-42bf-8d93-4a18e8e67c15 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.358541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a686b-58fe-42bf-8d93-4a18e8e67c15 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.358541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a686b-58fe-42bf-8d93-4a18e8e67c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.379303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-888a686b-58fe-42bf-8d93-4a18e8e67c15 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:16.380542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-888a686b-58fe-42bf-8d93-4a18e8e67c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:16.383828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 921/1828] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:16 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:16.384784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d13e6-f39a-4c2d-8c7e-e67a5d596cdc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.392990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-515d13e6-f39a-4c2d-8c7e-e67a5d596cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:16.414977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d13e6-f39a-4c2d-8c7e-e67a5d596cdc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.485553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 908/1829] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:16.485553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a686b-58fe-42bf-8d93-4a18e8e67c15 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.492475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a686b-58fe-42bf-8d93-4a18e8e67c15 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.498510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb8889-992f-4c8b-83a7-0b3d21ae3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.499221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb8889-992f-4c8b-83a7-0b3d21ae3aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.499544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb8889-992f-4c8b-83a7-0b3d21ae3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.500002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb8889-992f-4c8b-83a7-0b3d21ae3aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.500663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb8889-992f-4c8b-83a7-0b3d21ae3aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.502400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb8889-992f-4c8b-83a7-0b3d21ae3aa9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.502894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ea5dc-1c78-4eb2-b837-43f046000666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.503507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ea5dc-1c78-4eb2-b837-43f046000666 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.503826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ea5dc-1c78-4eb2-b837-43f046000666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.504021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ea5dc-1c78-4eb2-b837-43f046000666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.505121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ea5dc-1c78-4eb2-b837-43f046000666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.506242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ea5dc-1c78-4eb2-b837-43f046000666 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.517329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 922/1830] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:16.518809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824d14a-cf87-49cf-9940-cf7b4d6477a0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.519115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824d14a-cf87-49cf-9940-cf7b4d6477a0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.519419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824d14a-cf87-49cf-9940-cf7b4d6477a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.529718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 909/1831] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:16.529718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb8889-992f-4c8b-83a7-0b3d21ae3aa9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.540534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f824d14a-cf87-49cf-9940-cf7b4d6477a0 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:16.541741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f824d14a-cf87-49cf-9940-cf7b4d6477a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:16.544464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb8889-992f-4c8b-83a7-0b3d21ae3aa9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.550714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b165bae-fb65-4d8e-bc7a-250e6d101a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.551780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b165bae-fb65-4d8e-bc7a-250e6d101a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.551780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b165bae-fb65-4d8e-bc7a-250e6d101a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.552019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b165bae-fb65-4d8e-bc7a-250e6d101a3a admin admin] PATH_INFO: `/v3/projects/e8ef216619ed4bc4b2bfd58f755906ee/users/97a358414fc84858a1d0d42e1cdf9a79/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.555891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b165bae-fb65-4d8e-bc7a-250e6d101a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ef216619ed4bc4b2bfd58f755906ee, user_id=97a358414fc84858a1d0d42e1cdf9a79, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.557189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 923/1832] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:16.557189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824d14a-cf87-49cf-9940-cf7b4d6477a0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.564292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b165bae-fb65-4d8e-bc7a-250e6d101a3a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.567124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824d14a-cf87-49cf-9940-cf7b4d6477a0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.572359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e3449-e5a4-4d85-a268-2a9824a1b324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.573000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e3449-e5a4-4d85-a268-2a9824a1b324 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.573278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e3449-e5a4-4d85-a268-2a9824a1b324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.573552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e3449-e5a4-4d85-a268-2a9824a1b324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.574194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e3449-e5a4-4d85-a268-2a9824a1b324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.575933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e3449-e5a4-4d85-a268-2a9824a1b324 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.576253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 910/1833] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:16 2022] PUT /identity/v3/projects/e8ef216619ed4bc4b2bfd58f755906ee/users/97a358414fc84858a1d0d42e1cdf9a79/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:16.577110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b165bae-fb65-4d8e-bc7a-250e6d101a3a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.586835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 924/1834] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:16.588276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a17e62-c486-48ae-ab22-51ba9dbb7841 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.588565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a17e62-c486-48ae-ab22-51ba9dbb7841 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.588840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a17e62-c486-48ae-ab22-51ba9dbb7841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.617220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-85a17e62-c486-48ae-ab22-51ba9dbb7841 None None] MFA Rules not processed for user `97a358414fc84858a1d0d42e1cdf9a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:16.618439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-85a17e62-c486-48ae-ab22-51ba9dbb7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:16.644294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b165bae-fb65-4d8e-bc7a-250e6d101a3a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.645257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:16.649148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd011af-a4a6-4276-bf98-744d723cd354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.649758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd011af-a4a6-4276-bf98-744d723cd354 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.650078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd011af-a4a6-4276-bf98-744d723cd354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.650381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd011af-a4a6-4276-bf98-744d723cd354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.651038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd011af-a4a6-4276-bf98-744d723cd354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:16.651338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd011af-a4a6-4276-bf98-744d723cd354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.652984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd011af-a4a6-4276-bf98-744d723cd354 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.665456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 911/1835] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:16.666248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd011af-a4a6-4276-bf98-744d723cd354 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.678755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd011af-a4a6-4276-bf98-744d723cd354 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.684423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52186d43-48e0-4de8-8b29-6126d1c2b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.685813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52186d43-48e0-4de8-8b29-6126d1c2b834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.686361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52186d43-48e0-4de8-8b29-6126d1c2b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.686854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52186d43-48e0-4de8-8b29-6126d1c2b834 admin admin] PATH_INFO: `/v3/projects/029f3fbb57414a37af1cbd879f35d147/users/affad9b4587b443e9d64a148b8ee9551/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.699051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 925/1836] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:16.701104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a17e62-c486-48ae-ab22-51ba9dbb7841 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.708106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52186d43-48e0-4de8-8b29-6126d1c2b834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029f3fbb57414a37af1cbd879f35d147, user_id=affad9b4587b443e9d64a148b8ee9551, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.709237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52186d43-48e0-4de8-8b29-6126d1c2b834 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.714592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a17e62-c486-48ae-ab22-51ba9dbb7841 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.720032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91191a6e-494d-4e07-b7e2-5f4e96a3aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.720628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91191a6e-494d-4e07-b7e2-5f4e96a3aec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.720904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91191a6e-494d-4e07-b7e2-5f4e96a3aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.721172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91191a6e-494d-4e07-b7e2-5f4e96a3aec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.721804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91191a6e-494d-4e07-b7e2-5f4e96a3aec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.723711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91191a6e-494d-4e07-b7e2-5f4e96a3aec6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.789723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 912/1837] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:16 2022] PUT /identity/v3/projects/029f3fbb57414a37af1cbd879f35d147/users/affad9b4587b443e9d64a148b8ee9551/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:16.790617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52186d43-48e0-4de8-8b29-6126d1c2b834 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.792224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-52186d43-48e0-4de8-8b29-6126d1c2b834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:16.820383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 926/1838] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:16 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:16.821217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91191a6e-494d-4e07-b7e2-5f4e96a3aec6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:16.822947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-91191a6e-494d-4e07-b7e2-5f4e96a3aec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:16.860218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52186d43-48e0-4de8-8b29-6126d1c2b834 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.880890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91191a6e-494d-4e07-b7e2-5f4e96a3aec6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:16.884581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ef128-9174-43c4-8958-4254c2edf11f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.885183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ef128-9174-43c4-8958-4254c2edf11f service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.885456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ef128-9174-43c4-8958-4254c2edf11f service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.885729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ef128-9174-43c4-8958-4254c2edf11f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.887476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-174ef128-9174-43c4-8958-4254c2edf11f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:16.892458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:16.920417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:16.921091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.921374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.921654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] PATH_INFO: `/v3/projects/5581e8454f81443196bb75c53fb8153b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:16.922848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5581e8454f81443196bb75c53fb8153b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.924968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.957726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ef128-9174-43c4-8958-4254c2edf11f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:16.959248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ef128-9174-43c4-8958-4254c2edf11f service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:16.969789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 927/1839] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:16.971274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a4113-a540-4fd4-89fb-c13aafb613b7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:16.971565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a4113-a540-4fd4-89fb-c13aafb613b7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:16.971866 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a4113-a540-4fd4-89fb-c13aafb613b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.003274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7a5a4113-a540-4fd4-89fb-c13aafb613b7 None None] MFA Rules not processed for user `affad9b4587b443e9d64a148b8ee9551`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:17.004150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7a5a4113-a540-4fd4-89fb-c13aafb613b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:17.044071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5581e8454f81443196bb75c53fb8153b', 'request_id': 'req-e0072130-92f5-49ee-9ac5-b6db39341654'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.051358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5581e8454f81443196bb75c53fb8153b', 'request_id': 'req-e0072130-92f5-49ee-9ac5-b6db39341654'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.088989 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 928/1840] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:17.089815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a4113-a540-4fd4-89fb-c13aafb613b7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.110051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a4113-a540-4fd4-89fb-c13aafb613b7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.114772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5581e8454f81443196bb75c53fb8153b', 'request_id': 'req-e0072130-92f5-49ee-9ac5-b6db39341654'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.126032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] The token cache is being invalidate because project 5581e8454f81443196bb75c53fb8153b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:17.126346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.126996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.128541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 913/1841] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:16 2022] DELETE /identity/v3/projects/5581e8454f81443196bb75c53fb8153b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:17.129341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.130635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:17.172806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43b117-095a-4832-b98d-f6e0ddc86d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.173770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43b117-095a-4832-b98d-f6e0ddc86d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.173770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43b117-095a-4832-b98d-f6e0ddc86d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.174045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43b117-095a-4832-b98d-f6e0ddc86d43 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.174659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43b117-095a-4832-b98d-f6e0ddc86d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.176700 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43b117-095a-4832-b98d-f6e0ddc86d43 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.200996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0072130-92f5-49ee-9ac5-b6db39341654 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.207146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52b509-2d72-4cf0-b0dc-fadd5d902949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.207774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52b509-2d72-4cf0-b0dc-fadd5d902949 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.208070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52b509-2d72-4cf0-b0dc-fadd5d902949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.208341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52b509-2d72-4cf0-b0dc-fadd5d902949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.208981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52b509-2d72-4cf0-b0dc-fadd5d902949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.210896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52b509-2d72-4cf0-b0dc-fadd5d902949 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.275551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 929/1842] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:17 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:17.277002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43b117-095a-4832-b98d-f6e0ddc86d43 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.279969 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2e43b117-095a-4832-b98d-f6e0ddc86d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:17.292567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43b117-095a-4832-b98d-f6e0ddc86d43 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.297498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.298172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.298538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.298822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] PATH_INFO: `/v3/users/b239fe4f98c241b9b07800770afad4d1` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.300171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b239fe4f98c241b9b07800770afad4d1)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.302177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.318941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 914/1843] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:17 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:17.320280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52b509-2d72-4cf0-b0dc-fadd5d902949 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.324474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0a52b509-2d72-4cf0-b0dc-fadd5d902949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:17.417030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52b509-2d72-4cf0-b0dc-fadd5d902949 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.423016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d8a43-3db9-46da-b105-d99087ca0d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.431928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d8a43-3db9-46da-b105-d99087ca0d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.431928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d8a43-3db9-46da-b105-d99087ca0d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.431928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d8a43-3db9-46da-b105-d99087ca0d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.431928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d8a43-3db9-46da-b105-d99087ca0d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.431928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d8a43-3db9-46da-b105-d99087ca0d18 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.442127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 915/1844] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:17.442127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d8a43-3db9-46da-b105-d99087ca0d18 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.457657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d8a43-3db9-46da-b105-d99087ca0d18 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.466429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58b847-4c9c-457f-88a0-7a0fe2d0200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.467384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58b847-4c9c-457f-88a0-7a0fe2d0200b admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.467810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58b847-4c9c-457f-88a0-7a0fe2d0200b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.468098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58b847-4c9c-457f-88a0-7a0fe2d0200b admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.468756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58b847-4c9c-457f-88a0-7a0fe2d0200b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.470881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58b847-4c9c-457f-88a0-7a0fe2d0200b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.557906 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 916/1845] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:17 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:17.558908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58b847-4c9c-457f-88a0-7a0fe2d0200b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.572220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b239fe4f98c241b9b07800770afad4d1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.573843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b239fe4f98c241b9b07800770afad4d1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.575206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58b847-4c9c-457f-88a0-7a0fe2d0200b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.581207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b3a7-d3a5-48b5-80c6-7eae7259c2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.581800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b3a7-d3a5-48b5-80c6-7eae7259c2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.582221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b3a7-d3a5-48b5-80c6-7eae7259c2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.582530 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b3a7-d3a5-48b5-80c6-7eae7259c2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.583298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0b3a7-d3a5-48b5-80c6-7eae7259c2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.584996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0b3a7-d3a5-48b5-80c6-7eae7259c2ca admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.597418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 917/1846] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:17.597966 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b3a7-d3a5-48b5-80c6-7eae7259c2ca admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.608282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b3a7-d3a5-48b5-80c6-7eae7259c2ca admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.613173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d1b1-bc0e-4112-9729-b01170d79d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.613768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d1b1-bc0e-4112-9729-b01170d79d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.614046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d1b1-bc0e-4112-9729-b01170d79d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.615950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d1b1-bc0e-4112-9729-b01170d79d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.615950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51d1b1-bc0e-4112-9729-b01170d79d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.616658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51d1b1-bc0e-4112-9729-b01170d79d22 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.626819 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 918/1847] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:17.627763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d1b1-bc0e-4112-9729-b01170d79d22 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.637374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d1b1-bc0e-4112-9729-b01170d79d22 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.642695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf77269-0ab0-459c-b134-7ed65f4dbd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.643335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf77269-0ab0-459c-b134-7ed65f4dbd94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.643614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf77269-0ab0-459c-b134-7ed65f4dbd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.643984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf77269-0ab0-459c-b134-7ed65f4dbd94 admin admin] PATH_INFO: `/v3/projects/97e68d0a3ea949ff94421f1aaba9db96/users/6055bdc83e784c01930d070b5ca13f95/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.659157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf77269-0ab0-459c-b134-7ed65f4dbd94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e68d0a3ea949ff94421f1aaba9db96, user_id=6055bdc83e784c01930d070b5ca13f95, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.661848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf77269-0ab0-459c-b134-7ed65f4dbd94 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.663710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b239fe4f98c241b9b07800770afad4d1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.664396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b239fe4f98c241b9b07800770afad4d1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.677280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b239fe4f98c241b9b07800770afad4d1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:17.690363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 930/1848] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:17 2022] DELETE /identity/v3/users/b239fe4f98c241b9b07800770afad4d1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:17.691385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.692758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:17.774381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 919/1849] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:17 2022] PUT /identity/v3/projects/97e68d0a3ea949ff94421f1aaba9db96/users/6055bdc83e784c01930d070b5ca13f95/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:17.778052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7372c-773a-4a7a-9aa0-a3cc5c331d2a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.778377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7372c-773a-4a7a-9aa0-a3cc5c331d2a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.778622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7372c-773a-4a7a-9aa0-a3cc5c331d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.793559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10389fba-d149-42c7-a4fd-e3e369535f29 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.829069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8cf7372c-773a-4a7a-9aa0-a3cc5c331d2a None None] MFA Rules not processed for user `6055bdc83e784c01930d070b5ca13f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:17.830306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8cf7372c-773a-4a7a-9aa0-a3cc5c331d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:17.877374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b60b51-82b7-432e-b313-10620dec122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.878052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b60b51-82b7-432e-b313-10620dec122e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.878329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b60b51-82b7-432e-b313-10620dec122e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.878604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b60b51-82b7-432e-b313-10620dec122e admin admin] PATH_INFO: `/v3/projects/cca9c0aeff3c433ab8ae18cca006f324/users/dc486766f0064caf9c4ff88f2981f683/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.900943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b60b51-82b7-432e-b313-10620dec122e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca9c0aeff3c433ab8ae18cca006f324, user_id=dc486766f0064caf9c4ff88f2981f683, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.905587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b60b51-82b7-432e-b313-10620dec122e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.931553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 920/1850] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:17.936915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7372c-773a-4a7a-9aa0-a3cc5c331d2a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:17.938364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8cf7372c-773a-4a7a-9aa0-a3cc5c331d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:17.950972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:17.961815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7372c-773a-4a7a-9aa0-a3cc5c331d2a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:17.961815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facc8fe-6ab8-4dd4-8d63-d35029b68a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:17.961815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facc8fe-6ab8-4dd4-8d63-d35029b68a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:17.961815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facc8fe-6ab8-4dd4-8d63-d35029b68a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:17.962408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facc8fe-6ab8-4dd4-8d63-d35029b68a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:17.962408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facc8fe-6ab8-4dd4-8d63-d35029b68a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:17.963827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facc8fe-6ab8-4dd4-8d63-d35029b68a5e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:17.985324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 931/1851] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:17 2022] PUT /identity/v3/projects/cca9c0aeff3c433ab8ae18cca006f324/users/dc486766f0064caf9c4ff88f2981f683/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:17.990399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b60b51-82b7-432e-b313-10620dec122e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.054236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b60b51-82b7-432e-b313-10620dec122e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.059252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6d9c9-399d-4849-91a0-d1ee1cb9c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.059897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6d9c9-399d-4849-91a0-d1ee1cb9c145 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.060179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6d9c9-399d-4849-91a0-d1ee1cb9c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.060454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6d9c9-399d-4849-91a0-d1ee1cb9c145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.061688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6d9c9-399d-4849-91a0-d1ee1cb9c145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.063680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6d9c9-399d-4849-91a0-d1ee1cb9c145 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.072859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 921/1852] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:17 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:18.078160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facc8fe-6ab8-4dd4-8d63-d35029b68a5e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.085674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 932/1853] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:21:18.086937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6d9c9-399d-4849-91a0-d1ee1cb9c145 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.101473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6d9c9-399d-4849-91a0-d1ee1cb9c145 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.157184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facc8fe-6ab8-4dd4-8d63-d35029b68a5e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.162824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dfc6c-1466-4d92-800a-455a38d558dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.163448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dfc6c-1466-4d92-800a-455a38d558dd admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.163732 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dfc6c-1466-4d92-800a-455a38d558dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.164374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dfc6c-1466-4d92-800a-455a38d558dd admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.165028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dfc6c-1466-4d92-800a-455a38d558dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.167206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dfc6c-1466-4d92-800a-455a38d558dd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.177378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311a920-fe85-4ffb-b881-f0a26f8e6d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.178046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311a920-fe85-4ffb-b881-f0a26f8e6d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.178324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311a920-fe85-4ffb-b881-f0a26f8e6d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.178648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311a920-fe85-4ffb-b881-f0a26f8e6d8e admin admin] PATH_INFO: `/v3/projects/cca9c0aeff3c433ab8ae18cca006f324/users/dc486766f0064caf9c4ff88f2981f683/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.180961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311a920-fe85-4ffb-b881-f0a26f8e6d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca9c0aeff3c433ab8ae18cca006f324, user_id=dc486766f0064caf9c4ff88f2981f683, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.183627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311a920-fe85-4ffb-b881-f0a26f8e6d8e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.195573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 933/1854] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:18 2022] PUT /identity/v3/projects/cca9c0aeff3c433ab8ae18cca006f324/users/dc486766f0064caf9c4ff88f2981f683/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:18.208163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737722a-ebb5-4686-8861-b90956e82799 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.208452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737722a-ebb5-4686-8861-b90956e82799 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.208728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737722a-ebb5-4686-8861-b90956e82799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.237770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9737722a-ebb5-4686-8861-b90956e82799 None None] MFA Rules not processed for user `dc486766f0064caf9c4ff88f2981f683`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:18.238995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9737722a-ebb5-4686-8861-b90956e82799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:18.324207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 934/1855] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:18.335701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737722a-ebb5-4686-8861-b90956e82799 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.337143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9737722a-ebb5-4686-8861-b90956e82799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:18.508154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737722a-ebb5-4686-8861-b90956e82799 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.508154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fb689-d820-417d-9863-6915f6cce76f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.508154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fb689-d820-417d-9863-6915f6cce76f service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.508154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fb689-d820-417d-9863-6915f6cce76f service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.510341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fb689-d820-417d-9863-6915f6cce76f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.510341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fb689-d820-417d-9863-6915f6cce76f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.510341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fb689-d820-417d-9863-6915f6cce76f service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.510341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 935/1856] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:21:18.563704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fb689-d820-417d-9863-6915f6cce76f service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.596072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 922/1857] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:18 2022] POST /identity/v3/users => generated 293 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:18.606240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dfc6c-1466-4d92-800a-455a38d558dd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:18.610223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-182dfc6c-1466-4d92-800a-455a38d558dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:18.626759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dfc6c-1466-4d92-800a-455a38d558dd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.789677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fb689-d820-417d-9863-6915f6cce76f service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:18.789677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.789677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.789677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.791991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] PATH_INFO: `/v3/users/affad9b4587b443e9d64a148b8ee9551` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.791991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] RBAC: Authorizing `identity:delete_user(user_id=affad9b4587b443e9d64a148b8ee9551)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.791991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.792197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:18.792197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:18.792197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:18.792197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] PATH_INFO: `/v3/projects/b81ee4fd15b5471698ba291e3ec5ae49` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:18.792500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81ee4fd15b5471698ba291e3ec5ae49)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:18.792500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:18.933668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:19.107977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81ee4fd15b5471698ba291e3ec5ae49', 'request_id': 'req-42792986-b6cd-4bc9-90e4-05a6e8530e12'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.108639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affad9b4587b443e9d64a148b8ee9551'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.108915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affad9b4587b443e9d64a148b8ee9551'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.114816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81ee4fd15b5471698ba291e3ec5ae49', 'request_id': 'req-42792986-b6cd-4bc9-90e4-05a6e8530e12'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.183848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affad9b4587b443e9d64a148b8ee9551'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.184483 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affad9b4587b443e9d64a148b8ee9551'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.196776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affad9b4587b443e9d64a148b8ee9551'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.209488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 936/1858] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:18 2022] DELETE /identity/v3/users/affad9b4587b443e9d64a148b8ee9551 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:19.212296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.212296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.287769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733e0b-1346-4497-b14c-75534c78962f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.292522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74fa9f-bc1f-4f8e-b0ab-df813cdf7654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.293132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74fa9f-bc1f-4f8e-b0ab-df813cdf7654 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.293410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74fa9f-bc1f-4f8e-b0ab-df813cdf7654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.293686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74fa9f-bc1f-4f8e-b0ab-df813cdf7654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.294348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74fa9f-bc1f-4f8e-b0ab-df813cdf7654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.297691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81ee4fd15b5471698ba291e3ec5ae49', 'request_id': 'req-42792986-b6cd-4bc9-90e4-05a6e8530e12'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.297854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74fa9f-bc1f-4f8e-b0ab-df813cdf7654 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.312044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 937/1859] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:19.312346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] The token cache is being invalidate because project b81ee4fd15b5471698ba291e3ec5ae49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:19.312346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.312499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74fa9f-bc1f-4f8e-b0ab-df813cdf7654 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.312635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-df74fa9f-bc1f-4f8e-b0ab-df813cdf7654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.313301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42792986-b6cd-4bc9-90e4-05a6e8530e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.315130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 923/1860] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:18 2022] DELETE /identity/v3/projects/b81ee4fd15b5471698ba291e3ec5ae49 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:19.316467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf20ed4-7ae9-4081-84c9-c8d5c8d480da None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.316925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf20ed4-7ae9-4081-84c9-c8d5c8d480da None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.317202 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf20ed4-7ae9-4081-84c9-c8d5c8d480da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.330127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74fa9f-bc1f-4f8e-b0ab-df813cdf7654 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.335260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.335782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.336058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.336651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] PATH_INFO: `/v3/users/642fb00f2ea243cbbe2c11f2c78a785a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.337531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=642fb00f2ea243cbbe2c11f2c78a785a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.339444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.348645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7cf20ed4-7ae9-4081-84c9-c8d5c8d480da None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:19.349583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7cf20ed4-7ae9-4081-84c9-c8d5c8d480da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.360529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 924/1861] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:19.360529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf20ed4-7ae9-4081-84c9-c8d5c8d480da None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.360529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7cf20ed4-7ae9-4081-84c9-c8d5c8d480da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.371733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf20ed4-7ae9-4081-84c9-c8d5c8d480da None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.377211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84f9e3-6ce2-4b8b-b908-6fa318fb5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.377904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84f9e3-6ce2-4b8b-b908-6fa318fb5f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.378185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84f9e3-6ce2-4b8b-b908-6fa318fb5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.378458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84f9e3-6ce2-4b8b-b908-6fa318fb5f3b admin admin] PATH_INFO: `/v3/projects/e8784011fb0b4bc8bf66ebc8cec3ff75/users/cd79a29800494ec7858f53c0ae06d575/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.394455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84f9e3-6ce2-4b8b-b908-6fa318fb5f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8784011fb0b4bc8bf66ebc8cec3ff75, user_id=cd79a29800494ec7858f53c0ae06d575, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.397819 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84f9e3-6ce2-4b8b-b908-6fa318fb5f3b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.500161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 925/1862] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:19 2022] PUT /identity/v3/projects/e8784011fb0b4bc8bf66ebc8cec3ff75/users/cd79a29800494ec7858f53c0ae06d575/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:19.511610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bf8b8-df06-46ea-8cc5-abd7b0513556 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.511610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bf8b8-df06-46ea-8cc5-abd7b0513556 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.511610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bf8b8-df06-46ea-8cc5-abd7b0513556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.520521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a96bf8b8-df06-46ea-8cc5-abd7b0513556 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:19.521713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a96bf8b8-df06-46ea-8cc5-abd7b0513556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.581490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 926/1863] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:19.581490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bf8b8-df06-46ea-8cc5-abd7b0513556 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.582521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a96bf8b8-df06-46ea-8cc5-abd7b0513556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.620304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642fb00f2ea243cbbe2c11f2c78a785a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.620966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642fb00f2ea243cbbe2c11f2c78a785a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.638826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bf8b8-df06-46ea-8cc5-abd7b0513556 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.650205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b773-2a4c-4352-be08-e81e61255fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.650205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b773-2a4c-4352-be08-e81e61255fcc service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.650205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b773-2a4c-4352-be08-e81e61255fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.650205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b773-2a4c-4352-be08-e81e61255fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.653915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1b773-2a4c-4352-be08-e81e61255fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.656201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1b773-2a4c-4352-be08-e81e61255fcc service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.665692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 927/1864] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:19.666660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b773-2a4c-4352-be08-e81e61255fcc service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.676635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b773-2a4c-4352-be08-e81e61255fcc service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.683147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96165f-921a-40ab-ac0e-05939fa8c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.683147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96165f-921a-40ab-ac0e-05939fa8c44c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.683147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96165f-921a-40ab-ac0e-05939fa8c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.683147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96165f-921a-40ab-ac0e-05939fa8c44c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.684019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96165f-921a-40ab-ac0e-05939fa8c44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.685416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96165f-921a-40ab-ac0e-05939fa8c44c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.695516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 928/1865] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:19.696805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def433f0-779d-49c7-bf07-d86ebffd332a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.697093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def433f0-779d-49c7-bf07-d86ebffd332a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.697368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def433f0-779d-49c7-bf07-d86ebffd332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.717923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-def433f0-779d-49c7-bf07-d86ebffd332a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:19.719362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-def433f0-779d-49c7-bf07-d86ebffd332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.727325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 929/1866] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:19.728127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def433f0-779d-49c7-bf07-d86ebffd332a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.732668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642fb00f2ea243cbbe2c11f2c78a785a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.734318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642fb00f2ea243cbbe2c11f2c78a785a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.738147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def433f0-779d-49c7-bf07-d86ebffd332a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.745512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd5903-b520-4d35-8e31-6571f682ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.746255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd5903-b520-4d35-8e31-6571f682ae52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.746617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd5903-b520-4d35-8e31-6571f682ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.746961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd5903-b520-4d35-8e31-6571f682ae52 admin admin] PATH_INFO: `/v3/projects/e8784011fb0b4bc8bf66ebc8cec3ff75/users/cd79a29800494ec7858f53c0ae06d575/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.747967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642fb00f2ea243cbbe2c11f2c78a785a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:19.749073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd5903-b520-4d35-8e31-6571f682ae52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8784011fb0b4bc8bf66ebc8cec3ff75, user_id=cd79a29800494ec7858f53c0ae06d575, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.752447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd5903-b520-4d35-8e31-6571f682ae52 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.764944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 938/1867] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:19 2022] DELETE /identity/v3/users/642fb00f2ea243cbbe2c11f2c78a785a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:19.764944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.765485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 930/1868] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:19 2022] PUT /identity/v3/projects/e8784011fb0b4bc8bf66ebc8cec3ff75/users/cd79a29800494ec7858f53c0ae06d575/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:19.765580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.766496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a4d20-b417-4baa-8ccc-af22f0c3d995 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.766781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a4d20-b417-4baa-8ccc-af22f0c3d995 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.767090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a4d20-b417-4baa-8ccc-af22f0c3d995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.788150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-694a4d20-b417-4baa-8ccc-af22f0c3d995 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:19.789358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-694a4d20-b417-4baa-8ccc-af22f0c3d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.846659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417595f4-b2c4-4967-b0d7-bb9630b925ef admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:19.853741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:19.854368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.854654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.854929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.855586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:19.855944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:19.857529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:19.862848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 931/1869] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:19.865108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca96a62-5e7b-4053-87d4-c43e21caa765 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:19.865566 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca96a62-5e7b-4053-87d4-c43e21caa765 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:19.873135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca96a62-5e7b-4053-87d4-c43e21caa765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:19.875782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 939/1870] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:19.877096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:19.879736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.923867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-dca96a62-5e7b-4053-87d4-c43e21caa765 None None] MFA Rules not processed for user `cd79a29800494ec7858f53c0ae06d575`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:19.925191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-dca96a62-5e7b-4053-87d4-c43e21caa765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:19.999078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74572377-5453-4900-bf29-a7d8fb94e975 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.003542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a81a2-a37a-4b45-ad8d-eb8729b1a2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.004794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a81a2-a37a-4b45-ad8d-eb8729b1a2fc service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.004794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a81a2-a37a-4b45-ad8d-eb8729b1a2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.004794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a81a2-a37a-4b45-ad8d-eb8729b1a2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.019125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 932/1871] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:20.020340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca96a62-5e7b-4053-87d4-c43e21caa765 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:20.035940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a81a2-a37a-4b45-ad8d-eb8729b1a2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.035940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a81a2-a37a-4b45-ad8d-eb8729b1a2fc service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:20.054878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca96a62-5e7b-4053-87d4-c43e21caa765 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.055945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 940/1872] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:20.057627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a81a2-a37a-4b45-ad8d-eb8729b1a2fc service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:20.059275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6c1a81a2-a37a-4b45-ad8d-eb8729b1a2fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:20.060507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69cab4-f5d3-4f66-b4d0-20fc96ab0b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.062397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69cab4-f5d3-4f66-b4d0-20fc96ab0b83 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.062784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69cab4-f5d3-4f66-b4d0-20fc96ab0b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.063205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69cab4-f5d3-4f66-b4d0-20fc96ab0b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.064229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69cab4-f5d3-4f66-b4d0-20fc96ab0b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.066553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69cab4-f5d3-4f66-b4d0-20fc96ab0b83 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:20.140761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a81a2-a37a-4b45-ad8d-eb8729b1a2fc service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.145091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.145808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.146273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.146506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.149389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:20.174363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 933/1873] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:20 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:20.178724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69cab4-f5d3-4f66-b4d0-20fc96ab0b83 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:20.239871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.241320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:20.251780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 941/1874] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:20.322250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69cab4-f5d3-4f66-b4d0-20fc96ab0b83 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.322250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea89129-70c1-4546-965e-e8a8a7ef0532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.322250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea89129-70c1-4546-965e-e8a8a7ef0532 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.322250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea89129-70c1-4546-965e-e8a8a7ef0532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.323229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea89129-70c1-4546-965e-e8a8a7ef0532 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.323229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea89129-70c1-4546-965e-e8a8a7ef0532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.323229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea89129-70c1-4546-965e-e8a8a7ef0532 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:20.344712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:20.419997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:20.421543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:20.437107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08011a0-2349-498a-bcc0-36396bf5cb3d service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.444228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:20.446704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.447622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.448061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.448439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] PATH_INFO: `/v3/projects/029f3fbb57414a37af1cbd879f35d147` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.449691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029f3fbb57414a37af1cbd879f35d147)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.456323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:20.456418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 934/1875] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:20 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:20.456418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea89129-70c1-4546-965e-e8a8a7ef0532 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:20.466938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea89129-70c1-4546-965e-e8a8a7ef0532 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.473127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b6153-e04c-486b-9659-e3e37830b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.473742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b6153-e04c-486b-9659-e3e37830b063 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.474026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b6153-e04c-486b-9659-e3e37830b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.474306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b6153-e04c-486b-9659-e3e37830b063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.474961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b6153-e04c-486b-9659-e3e37830b063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.476614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b6153-e04c-486b-9659-e3e37830b063 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:20.496910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 935/1876] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:20.500178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b6153-e04c-486b-9659-e3e37830b063 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:20.511979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b6153-e04c-486b-9659-e3e37830b063 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.517692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644b8b3-9b1e-43e4-875f-ce281f830ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.519059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644b8b3-9b1e-43e4-875f-ce281f830ddc admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.519402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644b8b3-9b1e-43e4-875f-ce281f830ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.519686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644b8b3-9b1e-43e4-875f-ce281f830ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.520393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644b8b3-9b1e-43e4-875f-ce281f830ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.522408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644b8b3-9b1e-43e4-875f-ce281f830ddc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:20.537379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 936/1877] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:21:20.541669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644b8b3-9b1e-43e4-875f-ce281f830ddc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:20.553116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644b8b3-9b1e-43e4-875f-ce281f830ddc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.558263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3b97a-46c3-4cd9-a364-ff5aef618722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.558929 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3b97a-46c3-4cd9-a364-ff5aef618722 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.559206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3b97a-46c3-4cd9-a364-ff5aef618722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.559478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3b97a-46c3-4cd9-a364-ff5aef618722 admin admin] PATH_INFO: `/v3/projects/adbda5a5e16a49548cf81f3b269d1d28/users/6bf920d0908c412fa8472c306db8fe7a/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.574895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3b97a-46c3-4cd9-a364-ff5aef618722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbda5a5e16a49548cf81f3b269d1d28, user_id=6bf920d0908c412fa8472c306db8fe7a, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.578200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3b97a-46c3-4cd9-a364-ff5aef618722 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:20.727944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029f3fbb57414a37af1cbd879f35d147', 'request_id': 'req-25ed2450-c013-4895-9b79-fccb91a5f345'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:20.728142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 937/1878] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:20 2022] PUT /identity/v3/projects/adbda5a5e16a49548cf81f3b269d1d28/users/6bf920d0908c412fa8472c306db8fe7a/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:20.734608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029f3fbb57414a37af1cbd879f35d147', 'request_id': 'req-25ed2450-c013-4895-9b79-fccb91a5f345'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:20.738362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc1fa1-41a1-4a12-a1b2-98b08bcebf4e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.738655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc1fa1-41a1-4a12-a1b2-98b08bcebf4e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.738937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc1fa1-41a1-4a12-a1b2-98b08bcebf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.741418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029f3fbb57414a37af1cbd879f35d147', 'request_id': 'req-25ed2450-c013-4895-9b79-fccb91a5f345'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:20.767044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-62cc1fa1-41a1-4a12-a1b2-98b08bcebf4e None None] MFA Rules not processed for user `6bf920d0908c412fa8472c306db8fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:20.768277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-62cc1fa1-41a1-4a12-a1b2-98b08bcebf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:20.832426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 938/1879] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:20.844273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc1fa1-41a1-4a12-a1b2-98b08bcebf4e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:20.846813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-62cc1fa1-41a1-4a12-a1b2-98b08bcebf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:20.869607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] The token cache is being invalidate because project 029f3fbb57414a37af1cbd879f35d147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:20.870114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:20.872879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:20.874590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 942/1880] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:20 2022] DELETE /identity/v3/projects/029f3fbb57414a37af1cbd879f35d147 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:20.878596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:20.879939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:20.926411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc1fa1-41a1-4a12-a1b2-98b08bcebf4e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.931517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.932378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.932770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.933054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] PATH_INFO: `/v3/projects/d0a8213c70ca4a49bc78ff63e1a99634` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.934176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a8213c70ca4a49bc78ff63e1a99634)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.936660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:20.945563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed2450-c013-4895-9b79-fccb91a5f345 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:20.950453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:20.951097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:20.952988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:20.952988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] PATH_INFO: `/v3/users/dc486766f0064caf9c4ff88f2981f683` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:20.953381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc486766f0064caf9c4ff88f2981f683)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:20.955339 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:21.093352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a8213c70ca4a49bc78ff63e1a99634', 'request_id': 'req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.099579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a8213c70ca4a49bc78ff63e1a99634', 'request_id': 'req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.248113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a8213c70ca4a49bc78ff63e1a99634', 'request_id': 'req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.265282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc486766f0064caf9c4ff88f2981f683'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.265491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] The token cache is being invalidate because project d0a8213c70ca4a49bc78ff63e1a99634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:21.269082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.269205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc486766f0064caf9c4ff88f2981f683'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.269293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.270391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 939/1881] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:20 2022] DELETE /identity/v3/projects/d0a8213c70ca4a49bc78ff63e1a99634 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:21.271939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.274079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:21.333561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabfe71-c412-4b09-8e8d-b55cc2f8711f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.337132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.337726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.338007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.338275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.339994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:21.401282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc486766f0064caf9c4ff88f2981f683'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.402329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc486766f0064caf9c4ff88f2981f683'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.407070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:21.408723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:21.424111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b27ad821-c18c-445c-929f-5b80b3d8c321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc486766f0064caf9c4ff88f2981f683'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.424468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 940/1882] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:21.424468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.426356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:21.447023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 943/1883] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:20 2022] DELETE /identity/v3/users/dc486766f0064caf9c4ff88f2981f683 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:21.448307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c69ab-9e85-4976-8372-47d52a5ca3c8 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.448592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c69ab-9e85-4976-8372-47d52a5ca3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.452310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c69ab-9e85-4976-8372-47d52a5ca3c8 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.452310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 944/1884] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:21.452310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c69ab-9e85-4976-8372-47d52a5ca3c8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:21.461553 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8d5c69ab-9e85-4976-8372-47d52a5ca3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:21.508169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a6018-7007-4d0b-95aa-91f2f0b88afb service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.559852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c69ab-9e85-4976-8372-47d52a5ca3c8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:21.565621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.567494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.567990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.568440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] PATH_INFO: `/v3/users/6bf920d0908c412fa8472c306db8fe7a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.569844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf920d0908c412fa8472c306db8fe7a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:21.571891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:21.581406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:21.582077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.582356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.582631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] PATH_INFO: `/v3/users/07c04cf94bec49b0bac7083ceaff2f15` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.583814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c04cf94bec49b0bac7083ceaff2f15)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:21.585733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:21.793448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf920d0908c412fa8472c306db8fe7a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.794193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf920d0908c412fa8472c306db8fe7a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.798417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c04cf94bec49b0bac7083ceaff2f15'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.806875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c04cf94bec49b0bac7083ceaff2f15'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.820136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c04cf94bec49b0bac7083ceaff2f15'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.820876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c04cf94bec49b0bac7083ceaff2f15'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.821486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9fa282-6686-4894-9dfb-24cd47fc8629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c04cf94bec49b0bac7083ceaff2f15'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.903378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf920d0908c412fa8472c306db8fe7a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.904173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf920d0908c412fa8472c306db8fe7a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.918278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c2a250de-d2d9-4f94-9bc6-9509c35a4549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf920d0908c412fa8472c306db8fe7a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:21.933357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 945/1885] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:21 2022] DELETE /identity/v3/users/6bf920d0908c412fa8472c306db8fe7a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:21.934688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94e2a5-79b9-4477-b8f3-ae576bfe68ae None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.934978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94e2a5-79b9-4477-b8f3-ae576bfe68ae None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.935260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94e2a5-79b9-4477-b8f3-ae576bfe68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.959200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0d94e2a5-79b9-4477-b8f3-ae576bfe68ae None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:21.960705 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0d94e2a5-79b9-4477-b8f3-ae576bfe68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:21.972475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 941/1886] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:21 2022] DELETE /identity/v3/users/07c04cf94bec49b0bac7083ceaff2f15 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:21.972475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae513-4f50-437e-89d9-035183ee9652 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:21.972475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae513-4f50-437e-89d9-035183ee9652 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:21.972475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae513-4f50-437e-89d9-035183ee9652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:21.987334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f15ae513-4f50-437e-89d9-035183ee9652 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:21.988776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f15ae513-4f50-437e-89d9-035183ee9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.040138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 946/1887] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:21:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:22.041691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94e2a5-79b9-4477-b8f3-ae576bfe68ae None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.043015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0d94e2a5-79b9-4477-b8f3-ae576bfe68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.059086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 942/1888] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:22.064402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae513-4f50-437e-89d9-035183ee9652 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.068699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f15ae513-4f50-437e-89d9-035183ee9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.086590 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae513-4f50-437e-89d9-035183ee9652 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.093207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f15a3-cdd3-4431-9a47-a1e04cb9b699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.093830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f15a3-cdd3-4431-9a47-a1e04cb9b699 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.094117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f15a3-cdd3-4431-9a47-a1e04cb9b699 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.094386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f15a3-cdd3-4431-9a47-a1e04cb9b699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.103428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f15a3-cdd3-4431-9a47-a1e04cb9b699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.105118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f15a3-cdd3-4431-9a47-a1e04cb9b699 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.114721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94e2a5-79b9-4477-b8f3-ae576bfe68ae None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.145084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 943/1889] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:21:22.145084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f15a3-cdd3-4431-9a47-a1e04cb9b699 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.145084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c54f15a3-cdd3-4431-9a47-a1e04cb9b699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.146102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.146102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.146102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.146102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] PATH_INFO: `/v3/projects/cca9c0aeff3c433ab8ae18cca006f324` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.146424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca9c0aeff3c433ab8ae18cca006f324)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.146424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.178627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f15a3-cdd3-4431-9a47-a1e04cb9b699 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.182662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f92f4-51f0-47c6-a351-7989053c2760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.183279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f92f4-51f0-47c6-a351-7989053c2760 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.183558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f92f4-51f0-47c6-a351-7989053c2760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.183863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f92f4-51f0-47c6-a351-7989053c2760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.193654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f92f4-51f0-47c6-a351-7989053c2760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.195072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f92f4-51f0-47c6-a351-7989053c2760 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.204406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 944/1890] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:22.309428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca9c0aeff3c433ab8ae18cca006f324', 'request_id': 'req-38646a45-7cdc-4d4d-ac74-2ad7031ab054'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:22.320832 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca9c0aeff3c433ab8ae18cca006f324', 'request_id': 'req-38646a45-7cdc-4d4d-ac74-2ad7031ab054'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:22.327442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca9c0aeff3c433ab8ae18cca006f324', 'request_id': 'req-38646a45-7cdc-4d4d-ac74-2ad7031ab054'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:22.470510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] The token cache is being invalidate because project cca9c0aeff3c433ab8ae18cca006f324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:22.470829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:22.471526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-38646a45-7cdc-4d4d-ac74-2ad7031ab054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:22.473628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 947/1891] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:22 2022] DELETE /identity/v3/projects/cca9c0aeff3c433ab8ae18cca006f324 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:22.478661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb5054-7807-4bbb-92f5-94673e49d856 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.479147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb5054-7807-4bbb-92f5-94673e49d856 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.479784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb5054-7807-4bbb-92f5-94673e49d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.500088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e0cb5054-7807-4bbb-92f5-94673e49d856 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:22.501336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e0cb5054-7807-4bbb-92f5-94673e49d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.563705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 945/1892] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:22.571174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa39b7-1120-4019-a0f7-034bf4f9c377 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.571470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa39b7-1120-4019-a0f7-034bf4f9c377 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.571767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa39b7-1120-4019-a0f7-034bf4f9c377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.591380 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-35aa39b7-1120-4019-a0f7-034bf4f9c377 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:22.593371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-35aa39b7-1120-4019-a0f7-034bf4f9c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.601173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 948/1893] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:22.605580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb5054-7807-4bbb-92f5-94673e49d856 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.616241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb5054-7807-4bbb-92f5-94673e49d856 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.621555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.622210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.622495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.622770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.623709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:22.624385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.626105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.639389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 946/1894] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:22.643734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa39b7-1120-4019-a0f7-034bf4f9c377 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.653837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa39b7-1120-4019-a0f7-034bf4f9c377 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.659386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837985b-32b5-46f3-a7af-f7283dec41ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.660059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837985b-32b5-46f3-a7af-f7283dec41ea admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.660341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837985b-32b5-46f3-a7af-f7283dec41ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.660608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837985b-32b5-46f3-a7af-f7283dec41ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.661256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837985b-32b5-46f3-a7af-f7283dec41ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.664597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837985b-32b5-46f3-a7af-f7283dec41ea admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.694659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.696836 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.711865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8143-0612-4d64-abaa-8434342ab211 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.718040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.718767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.719048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.719328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] PATH_INFO: `/v3/projects/64832a07c8e640e7ace563026eed099c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.720562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] RBAC: Authorizing `identity:delete_project(project_id=64832a07c8e640e7ace563026eed099c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.722613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.783541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 949/1895] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:22 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:22.784829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837985b-32b5-46f3-a7af-f7283dec41ea admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:22.788183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2837985b-32b5-46f3-a7af-f7283dec41ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:22.859228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837985b-32b5-46f3-a7af-f7283dec41ea admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:22.864768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:22.865426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:22.865703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:22.865978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] PATH_INFO: `/v3/projects/adbda5a5e16a49548cf81f3b269d1d28` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:22.867213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbda5a5e16a49548cf81f3b269d1d28)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:22.869466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:22.904400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64832a07c8e640e7ace563026eed099c', 'request_id': 'req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:22.915702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64832a07c8e640e7ace563026eed099c', 'request_id': 'req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:23.087121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64832a07c8e640e7ace563026eed099c', 'request_id': 'req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:23.101152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] The token cache is being invalidate because project 64832a07c8e640e7ace563026eed099c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:23.101512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:23.102651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:23.104546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 947/1896] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:22 2022] DELETE /identity/v3/projects/64832a07c8e640e7ace563026eed099c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:23.104854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.106164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:23.116955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbda5a5e16a49548cf81f3b269d1d28', 'request_id': 'req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:23.123791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbda5a5e16a49548cf81f3b269d1d28', 'request_id': 'req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:23.130273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbda5a5e16a49548cf81f3b269d1d28', 'request_id': 'req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:23.175120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d79e9-faf8-44e6-b0e2-7109c4e159be admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.257548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb6cbe-0dfe-4e1d-a6cf-cbca6340fab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.258092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb6cbe-0dfe-4e1d-a6cf-cbca6340fab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.258365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb6cbe-0dfe-4e1d-a6cf-cbca6340fab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.258635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb6cbe-0dfe-4e1d-a6cf-cbca6340fab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.259262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb6cbe-0dfe-4e1d-a6cf-cbca6340fab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.261222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb6cbe-0dfe-4e1d-a6cf-cbca6340fab1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.297766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] The token cache is being invalidate because project adbda5a5e16a49548cf81f3b269d1d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:23.298055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:23.298692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3d419949-7f08-4a50-8fb1-9ef7fccfb9e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:23.300394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 950/1897] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:22 2022] DELETE /identity/v3/projects/adbda5a5e16a49548cf81f3b269d1d28 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:23.301644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ce8cf-3a95-466e-8468-535840eff8f4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.301967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ce8cf-3a95-466e-8468-535840eff8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.302261 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ce8cf-3a95-466e-8468-535840eff8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.323098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-146ce8cf-3a95-466e-8468-535840eff8f4 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:23.325212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-146ce8cf-3a95-466e-8468-535840eff8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:23.333522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 951/1898] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:23.334369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ce8cf-3a95-466e-8468-535840eff8f4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.335611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-146ce8cf-3a95-466e-8468-535840eff8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:23.397387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 948/1899] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:23 2022] POST /identity/v3/users => generated 284 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:23.397387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea122-8471-4436-b41c-f54c53e3c1ba None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.397387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea122-8471-4436-b41c-f54c53e3c1ba None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.397387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea122-8471-4436-b41c-f54c53e3c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.403076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ce8cf-3a95-466e-8468-535840eff8f4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.408623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125c92f-6cdf-4298-93f6-5b8622237f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.409553 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c92f-6cdf-4298-93f6-5b8622237f71 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.409977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c92f-6cdf-4298-93f6-5b8622237f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.410407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c92f-6cdf-4298-93f6-5b8622237f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.412602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9125c92f-6cdf-4298-93f6-5b8622237f71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:23.425577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c35ea122-8471-4436-b41c-f54c53e3c1ba None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:23.426894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c35ea122-8471-4436-b41c-f54c53e3c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:23.439942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 949/1900] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:23.444375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875ba96-9413-4237-9c1a-f28b718d91d5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.444375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875ba96-9413-4237-9c1a-f28b718d91d5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.444375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875ba96-9413-4237-9c1a-f28b718d91d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.469651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5875ba96-9413-4237-9c1a-f28b718d91d5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:23.473014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5875ba96-9413-4237-9c1a-f28b718d91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:23.481867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 950/1901] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:23.483167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875ba96-9413-4237-9c1a-f28b718d91d5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.492578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5875ba96-9413-4237-9c1a-f28b718d91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:23.509497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875ba96-9413-4237-9c1a-f28b718d91d5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.510566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125c92f-6cdf-4298-93f6-5b8622237f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.512322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125c92f-6cdf-4298-93f6-5b8622237f71 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.515349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09bd15-df85-4543-80f6-fbfb7a6e633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.516184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09bd15-df85-4543-80f6-fbfb7a6e633b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.516565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09bd15-df85-4543-80f6-fbfb7a6e633b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.516940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09bd15-df85-4543-80f6-fbfb7a6e633b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.517697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09bd15-df85-4543-80f6-fbfb7a6e633b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.520620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09bd15-df85-4543-80f6-fbfb7a6e633b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.527922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 952/1902] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:23.528822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd452602-24b9-4327-a95f-ff509cc588c1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.530229 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd452602-24b9-4327-a95f-ff509cc588c1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.530229 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd452602-24b9-4327-a95f-ff509cc588c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.537787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 951/1903] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:23.538877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09bd15-df85-4543-80f6-fbfb7a6e633b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.566932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09bd15-df85-4543-80f6-fbfb7a6e633b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.572625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bd452602-24b9-4327-a95f-ff509cc588c1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:23.576075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732105f-5701-4552-9a3c-b209b09e89d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.576246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bd452602-24b9-4327-a95f-ff509cc588c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:23.576361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732105f-5701-4552-9a3c-b209b09e89d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.576361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732105f-5701-4552-9a3c-b209b09e89d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.576361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732105f-5701-4552-9a3c-b209b09e89d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.576361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732105f-5701-4552-9a3c-b209b09e89d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:23.580375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732105f-5701-4552-9a3c-b209b09e89d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.582909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 953/1904] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:23.583148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732105f-5701-4552-9a3c-b209b09e89d6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.583760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd452602-24b9-4327-a95f-ff509cc588c1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.593725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd452602-24b9-4327-a95f-ff509cc588c1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.598649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fa062-e63a-4c6d-82d0-758beee384aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.599513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fa062-e63a-4c6d-82d0-758beee384aa admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.599940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fa062-e63a-4c6d-82d0-758beee384aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.600291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fa062-e63a-4c6d-82d0-758beee384aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.601125 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fa062-e63a-4c6d-82d0-758beee384aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.604903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 952/1905] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:23.605043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fa062-e63a-4c6d-82d0-758beee384aa admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.605135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732105f-5701-4552-9a3c-b209b09e89d6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.615921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 954/1906] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:23.616136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fa062-e63a-4c6d-82d0-758beee384aa admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.617571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732105f-5701-4552-9a3c-b209b09e89d6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.622561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d3b09-13b3-49de-8762-525399722234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.624043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d3b09-13b3-49de-8762-525399722234 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.624394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d3b09-13b3-49de-8762-525399722234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.625246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d3b09-13b3-49de-8762-525399722234 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.625510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d3b09-13b3-49de-8762-525399722234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:23.625907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d3b09-13b3-49de-8762-525399722234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.627652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d3b09-13b3-49de-8762-525399722234 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.629210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fa062-e63a-4c6d-82d0-758beee384aa admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.633991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87defa9c-e9ee-444b-942d-23806df72380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.634593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87defa9c-e9ee-444b-942d-23806df72380 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.634868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87defa9c-e9ee-444b-942d-23806df72380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.635138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87defa9c-e9ee-444b-942d-23806df72380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.635834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87defa9c-e9ee-444b-942d-23806df72380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.637891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87defa9c-e9ee-444b-942d-23806df72380 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.648103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 953/1907] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:23.650386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d3b09-13b3-49de-8762-525399722234 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.663358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d3b09-13b3-49de-8762-525399722234 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.668235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092fbc3-f49d-49a1-82aa-1d9bfd1f4d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.668888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092fbc3-f49d-49a1-82aa-1d9bfd1f4d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.669167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092fbc3-f49d-49a1-82aa-1d9bfd1f4d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.669448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092fbc3-f49d-49a1-82aa-1d9bfd1f4d71 admin admin] PATH_INFO: `/v3/projects/cbf812d7f6804f329b538b8124fdf982/users/30df50e776674863b4a2ae9b11148a66/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.690109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092fbc3-f49d-49a1-82aa-1d9bfd1f4d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf812d7f6804f329b538b8124fdf982, user_id=30df50e776674863b4a2ae9b11148a66, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.692816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092fbc3-f49d-49a1-82aa-1d9bfd1f4d71 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:23.839666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 954/1908] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:23 2022] PUT /identity/v3/projects/cbf812d7f6804f329b538b8124fdf982/users/30df50e776674863b4a2ae9b11148a66/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:23.840575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092fbc3-f49d-49a1-82aa-1d9bfd1f4d71 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.851977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 955/1909] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:23 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:23.854896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192cf67-40d7-49d0-8dd7-0b750e911b2a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.855441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192cf67-40d7-49d0-8dd7-0b750e911b2a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.855724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192cf67-40d7-49d0-8dd7-0b750e911b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.883945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5192cf67-40d7-49d0-8dd7-0b750e911b2a None None] MFA Rules not processed for user `30df50e776674863b4a2ae9b11148a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:23.885137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5192cf67-40d7-49d0-8dd7-0b750e911b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:23.907400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092fbc3-f49d-49a1-82aa-1d9bfd1f4d71 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:23.974661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 956/1910] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:23.975300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192cf67-40d7-49d0-8dd7-0b750e911b2a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:23.986348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592df91-a1fe-4733-ad0a-1438759abb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:23.986973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592df91-a1fe-4733-ad0a-1438759abb81 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:23.987305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592df91-a1fe-4733-ad0a-1438759abb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:23.987599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592df91-a1fe-4733-ad0a-1438759abb81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:23.988302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592df91-a1fe-4733-ad0a-1438759abb81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:23.990328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592df91-a1fe-4733-ad0a-1438759abb81 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:24.002926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192cf67-40d7-49d0-8dd7-0b750e911b2a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:24.009586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d121-3bd4-438f-a20f-743329ea206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:24.011893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d121-3bd4-438f-a20f-743329ea206a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:24.011893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d121-3bd4-438f-a20f-743329ea206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:24.011893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d121-3bd4-438f-a20f-743329ea206a admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:24.011893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309d121-3bd4-438f-a20f-743329ea206a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:24.015811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309d121-3bd4-438f-a20f-743329ea206a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.044498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 955/1911] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:23 2022] POST /identity/v3/projects => generated 375 bytes in 1204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:25.046271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592df91-a1fe-4733-ad0a-1438759abb81 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.047895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 957/1912] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:23 2022] POST /identity/v3/users => generated 283 bytes in 1074 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:25.049146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d121-3bd4-438f-a20f-743329ea206a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.064024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d121-3bd4-438f-a20f-743329ea206a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.125433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864eef0-0867-4d07-9fc1-024c3a2f8082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.126051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864eef0-0867-4d07-9fc1-024c3a2f8082 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.126331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864eef0-0867-4d07-9fc1-024c3a2f8082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.126606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864eef0-0867-4d07-9fc1-024c3a2f8082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.127262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864eef0-0867-4d07-9fc1-024c3a2f8082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.128950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864eef0-0867-4d07-9fc1-024c3a2f8082 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.137644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592df91-a1fe-4733-ad0a-1438759abb81 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.139362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 958/1913] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:25.140403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864eef0-0867-4d07-9fc1-024c3a2f8082 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.143972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f1b04-a631-439c-81dd-57cd4c852edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.144593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f1b04-a631-439c-81dd-57cd4c852edf admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.144872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f1b04-a631-439c-81dd-57cd4c852edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.145151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f1b04-a631-439c-81dd-57cd4c852edf admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.145830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f1b04-a631-439c-81dd-57cd4c852edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.147919 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f1b04-a631-439c-81dd-57cd4c852edf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.150351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864eef0-0867-4d07-9fc1-024c3a2f8082 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.155384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4d25b-c545-4cfe-80dc-d1e0676da332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.156016 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4d25b-c545-4cfe-80dc-d1e0676da332 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.156296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4d25b-c545-4cfe-80dc-d1e0676da332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.156571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4d25b-c545-4cfe-80dc-d1e0676da332 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.157194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4d25b-c545-4cfe-80dc-d1e0676da332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.159113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4d25b-c545-4cfe-80dc-d1e0676da332 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.372179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 956/1914] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:25 2022] POST /identity/v3/projects => generated 367 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:25.375159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f1b04-a631-439c-81dd-57cd4c852edf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.434159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 959/1915] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:25 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:25.435065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4d25b-c545-4cfe-80dc-d1e0676da332 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.457892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4d25b-c545-4cfe-80dc-d1e0676da332 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.489277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f1b04-a631-439c-81dd-57cd4c852edf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.495623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3a29b-453b-44ad-80a8-db379c6a181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.496523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3a29b-453b-44ad-80a8-db379c6a181c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.499914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3a29b-453b-44ad-80a8-db379c6a181c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.499914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3a29b-453b-44ad-80a8-db379c6a181c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.499914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3a29b-453b-44ad-80a8-db379c6a181c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.500995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3a29b-453b-44ad-80a8-db379c6a181c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.512837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 957/1916] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:25.513699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3a29b-453b-44ad-80a8-db379c6a181c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.525449 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3a29b-453b-44ad-80a8-db379c6a181c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.528519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519219-4019-4f48-96d1-1d8365dfd12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.529148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519219-4019-4f48-96d1-1d8365dfd12a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.529423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519219-4019-4f48-96d1-1d8365dfd12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.530231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519219-4019-4f48-96d1-1d8365dfd12a admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.531320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e440522-0579-420d-ab28-040fb5b90fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.531430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09519219-4019-4f48-96d1-1d8365dfd12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.531995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e440522-0579-420d-ab28-040fb5b90fda admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.532328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e440522-0579-420d-ab28-040fb5b90fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.532608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e440522-0579-420d-ab28-040fb5b90fda admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.533819 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e440522-0579-420d-ab28-040fb5b90fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.533902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09519219-4019-4f48-96d1-1d8365dfd12a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.534814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e440522-0579-420d-ab28-040fb5b90fda admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.552153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 958/1917] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:25.552153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e440522-0579-420d-ab28-040fb5b90fda admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.553335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0e440522-0579-420d-ab28-040fb5b90fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:25.566698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e440522-0579-420d-ab28-040fb5b90fda admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.571605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.572259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.576112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.576112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] PATH_INFO: `/v3/users/6055bdc83e784c01930d070b5ca13f95` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.576112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6055bdc83e784c01930d070b5ca13f95)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.576112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.663930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 960/1918] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:25 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:25.664749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519219-4019-4f48-96d1-1d8365dfd12a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.674962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519219-4019-4f48-96d1-1d8365dfd12a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.679486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b62fe-074c-49f0-8faf-3c143b63fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.680401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b62fe-074c-49f0-8faf-3c143b63fa20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.680680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b62fe-074c-49f0-8faf-3c143b63fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.680955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b62fe-074c-49f0-8faf-3c143b63fa20 admin admin] PATH_INFO: `/v3/projects/9203f8d79c524f1486f6e39fc9c5b4cb/users/651874600ac94b319ecf7d56714d7116/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.687207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:25.700609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b62fe-074c-49f0-8faf-3c143b63fa20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9203f8d79c524f1486f6e39fc9c5b4cb, user_id=651874600ac94b319ecf7d56714d7116, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.703662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b62fe-074c-49f0-8faf-3c143b63fa20 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.781021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 961/1919] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:25 2022] PUT /identity/v3/projects/9203f8d79c524f1486f6e39fc9c5b4cb/users/651874600ac94b319ecf7d56714d7116/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:25.782417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b62fe-074c-49f0-8faf-3c143b63fa20 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.786985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:25.799491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6055bdc83e784c01930d070b5ca13f95'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:25.813502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6055bdc83e784c01930d070b5ca13f95'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:25.825742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6055bdc83e784c01930d070b5ca13f95'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:25.827016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6055bdc83e784c01930d070b5ca13f95'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:25.827825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6055bdc83e784c01930d070b5ca13f95'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:25.861534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b62fe-074c-49f0-8faf-3c143b63fa20 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.866405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaddbe-4da2-483e-8d9d-62e5b2488fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.867971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaddbe-4da2-483e-8d9d-62e5b2488fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.868489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaddbe-4da2-483e-8d9d-62e5b2488fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.868780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaddbe-4da2-483e-8d9d-62e5b2488fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.869450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaddbe-4da2-483e-8d9d-62e5b2488fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.871062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaddbe-4da2-483e-8d9d-62e5b2488fb6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.881299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 962/1920] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:25.882114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaddbe-4da2-483e-8d9d-62e5b2488fb6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.883956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5faaddbe-4da2-483e-8d9d-62e5b2488fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:25.897319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaddbe-4da2-483e-8d9d-62e5b2488fb6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:25.902460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f9b21-9b50-47cd-beee-21198354a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:25.903124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9b21-9b50-47cd-beee-21198354a23e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.903405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9b21-9b50-47cd-beee-21198354a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.903683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9b21-9b50-47cd-beee-21198354a23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.904524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f9b21-9b50-47cd-beee-21198354a23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:25.906983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f9b21-9b50-47cd-beee-21198354a23e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:25.923093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 963/1921] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:25.924773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b42b9-ad75-4333-a55f-c005cf0d6a98 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:25.925107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b42b9-ad75-4333-a55f-c005cf0d6a98 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:25.925399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b42b9-ad75-4333-a55f-c005cf0d6a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:25.927953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 959/1922] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:25 2022] DELETE /identity/v3/users/6055bdc83e784c01930d070b5ca13f95 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:25.927953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:25.931910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:25.967897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ec7b42b9-ad75-4333-a55f-c005cf0d6a98 None None] MFA Rules not processed for user `651874600ac94b319ecf7d56714d7116`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:25.971043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ec7b42b9-ad75-4333-a55f-c005cf0d6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.040126 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e25d-1a7f-4248-8e5e-0a7d5a24c74f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.045438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287850a6-1fe5-436f-8b03-774eb4a2d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.046163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287850a6-1fe5-436f-8b03-774eb4a2d037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.046381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287850a6-1fe5-436f-8b03-774eb4a2d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.055403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287850a6-1fe5-436f-8b03-774eb4a2d037 admin admin] PATH_INFO: `/v3/projects/733da636abfd4cb5b7d5d51a5c3c0bc3/users/a6621f9ad4404e7fa83a1d197787ffb5/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.064557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287850a6-1fe5-436f-8b03-774eb4a2d037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733da636abfd4cb5b7d5d51a5c3c0bc3, user_id=a6621f9ad4404e7fa83a1d197787ffb5, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.068935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 964/1923] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:26.068935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b42b9-ad75-4333-a55f-c005cf0d6a98 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.069480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287850a6-1fe5-436f-8b03-774eb4a2d037 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.080708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b42b9-ad75-4333-a55f-c005cf0d6a98 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.085364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0f8ba-3e84-4b9c-8a9e-ad17a689560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.086027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f8ba-3e84-4b9c-8a9e-ad17a689560a admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.086305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f8ba-3e84-4b9c-8a9e-ad17a689560a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.086692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f8ba-3e84-4b9c-8a9e-ad17a689560a admin admin] PATH_INFO: `/v3/projects/0eaac4c86d65466391d0a73411bafce8/users/6f597e63609c484da7b7735556550475/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.107952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0f8ba-3e84-4b9c-8a9e-ad17a689560a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaac4c86d65466391d0a73411bafce8, user_id=6f597e63609c484da7b7735556550475, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.107952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0f8ba-3e84-4b9c-8a9e-ad17a689560a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.184623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 960/1924] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:25 2022] PUT /identity/v3/projects/733da636abfd4cb5b7d5d51a5c3c0bc3/users/a6621f9ad4404e7fa83a1d197787ffb5/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:26.186599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800e274-d445-4d87-8b1a-fbb243d18021 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.187051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800e274-d445-4d87-8b1a-fbb243d18021 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.187339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800e274-d445-4d87-8b1a-fbb243d18021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.208443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c800e274-d445-4d87-8b1a-fbb243d18021 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:26.209641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c800e274-d445-4d87-8b1a-fbb243d18021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.246017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 965/1925] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:26 2022] PUT /identity/v3/projects/0eaac4c86d65466391d0a73411bafce8/users/6f597e63609c484da7b7735556550475/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:26.247288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0f8ba-3e84-4b9c-8a9e-ad17a689560a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.250136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-60d0f8ba-3e84-4b9c-8a9e-ad17a689560a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.275427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 961/1926] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:26.276962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93f37-24f9-433d-bf6d-2f0dbdc623b4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.277245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93f37-24f9-433d-bf6d-2f0dbdc623b4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.278021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93f37-24f9-433d-bf6d-2f0dbdc623b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.311801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f6d93f37-24f9-433d-bf6d-2f0dbdc623b4 None None] MFA Rules not processed for user `a6621f9ad4404e7fa83a1d197787ffb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:26.313123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f6d93f37-24f9-433d-bf6d-2f0dbdc623b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.321482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0f8ba-3e84-4b9c-8a9e-ad17a689560a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.326119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730673e-56e8-4e08-a476-0abf760a9d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.327281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730673e-56e8-4e08-a476-0abf760a9d1a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.327552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730673e-56e8-4e08-a476-0abf760a9d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.327877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730673e-56e8-4e08-a476-0abf760a9d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.328506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730673e-56e8-4e08-a476-0abf760a9d1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.330409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730673e-56e8-4e08-a476-0abf760a9d1a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.380148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 962/1927] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:26.380911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93f37-24f9-433d-bf6d-2f0dbdc623b4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.391982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93f37-24f9-433d-bf6d-2f0dbdc623b4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.397584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45873ee-cb4f-4e46-a245-8627fd6f3405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.397584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45873ee-cb4f-4e46-a245-8627fd6f3405 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.397584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45873ee-cb4f-4e46-a245-8627fd6f3405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.397869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45873ee-cb4f-4e46-a245-8627fd6f3405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.398587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45873ee-cb4f-4e46-a245-8627fd6f3405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.400261 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45873ee-cb4f-4e46-a245-8627fd6f3405 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.410218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 963/1928] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:26.411052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45873ee-cb4f-4e46-a245-8627fd6f3405 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.412725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d45873ee-cb4f-4e46-a245-8627fd6f3405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.471111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 966/1929] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:26 2022] POST /identity/v3/projects => generated 363 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:26.472118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730673e-56e8-4e08-a476-0abf760a9d1a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.473786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0730673e-56e8-4e08-a476-0abf760a9d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.475408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45873ee-cb4f-4e46-a245-8627fd6f3405 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.537913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9454c-d3eb-4c5e-a44e-e6bf70ec298f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.538552 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9454c-d3eb-4c5e-a44e-e6bf70ec298f service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.538833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9454c-d3eb-4c5e-a44e-e6bf70ec298f service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.539104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9454c-d3eb-4c5e-a44e-e6bf70ec298f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.587297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730673e-56e8-4e08-a476-0abf760a9d1a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.591082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b5dd-81dd-4507-a188-db5f5515871d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8855e3e7fc84cd9ba1afaef4cc308c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.591701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b5dd-81dd-4507-a188-db5f5515871d service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.592054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b5dd-81dd-4507-a188-db5f5515871d service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.592493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b5dd-81dd-4507-a188-db5f5515871d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.612500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9454c-d3eb-4c5e-a44e-e6bf70ec298f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.614036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9454c-d3eb-4c5e-a44e-e6bf70ec298f service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.624910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 964/1930] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:26.625614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9454c-d3eb-4c5e-a44e-e6bf70ec298f service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.635152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9454c-d3eb-4c5e-a44e-e6bf70ec298f service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.644475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0187e-40f7-43c6-a2fa-bafbbe12a820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.645168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0187e-40f7-43c6-a2fa-bafbbe12a820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.645416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0187e-40f7-43c6-a2fa-bafbbe12a820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.646126 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0187e-40f7-43c6-a2fa-bafbbe12a820 admin admin] PATH_INFO: `/v3/projects/0eaac4c86d65466391d0a73411bafce8/users/6f597e63609c484da7b7735556550475/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.649113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0187e-40f7-43c6-a2fa-bafbbe12a820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaac4c86d65466391d0a73411bafce8, user_id=6f597e63609c484da7b7735556550475, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.651816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0187e-40f7-43c6-a2fa-bafbbe12a820 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.665325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 965/1931] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:26 2022] PUT /identity/v3/projects/0eaac4c86d65466391d0a73411bafce8/users/6f597e63609c484da7b7735556550475/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:26.665794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b5dd-81dd-4507-a188-db5f5515871d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.666141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0187e-40f7-43c6-a2fa-bafbbe12a820 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.668113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b5dd-81dd-4507-a188-db5f5515871d service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.698776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 967/1932] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:26.699901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d3316-94cb-4d28-b559-030596aadce0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.700185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d3316-94cb-4d28-b559-030596aadce0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.700513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d3316-94cb-4d28-b559-030596aadce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.751225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0d2d3316-94cb-4d28-b559-030596aadce0 None None] MFA Rules not processed for user `6f597e63609c484da7b7735556550475`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:26.753454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0d2d3316-94cb-4d28-b559-030596aadce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.796560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0187e-40f7-43c6-a2fa-bafbbe12a820 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.803927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47088cf4-2a7a-46ff-8491-aee77dffce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.804541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47088cf4-2a7a-46ff-8491-aee77dffce60 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.805082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47088cf4-2a7a-46ff-8491-aee77dffce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.805353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47088cf4-2a7a-46ff-8491-aee77dffce60 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.805985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47088cf4-2a7a-46ff-8491-aee77dffce60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.807914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47088cf4-2a7a-46ff-8491-aee77dffce60 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.848147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 968/1933] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:26.895282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d3316-94cb-4d28-b559-030596aadce0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.900191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0d2d3316-94cb-4d28-b559-030596aadce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:26.939295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 966/1934] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:26 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:26.941197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47088cf4-2a7a-46ff-8491-aee77dffce60 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.954319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47088cf4-2a7a-46ff-8491-aee77dffce60 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.959727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4f9e4-8f02-443c-84de-692f63780378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.960881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4f9e4-8f02-443c-84de-692f63780378 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.960881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4f9e4-8f02-443c-84de-692f63780378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.961048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4f9e4-8f02-443c-84de-692f63780378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:26.961798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4f9e4-8f02-443c-84de-692f63780378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:26.963705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4f9e4-8f02-443c-84de-692f63780378 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:26.975797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 967/1935] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:26.980028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4f9e4-8f02-443c-84de-692f63780378 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:26.990505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4f9e4-8f02-443c-84de-692f63780378 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:26.995724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03547c-9e97-466e-9718-afcfd9b71c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:26.996407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03547c-9e97-466e-9718-afcfd9b71c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:26.996685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03547c-9e97-466e-9718-afcfd9b71c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:26.996943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03547c-9e97-466e-9718-afcfd9b71c8b admin admin] PATH_INFO: `/v3/projects/aa1f5db3e2424b00bf532c3e0d1864ef/users/d06cba07cb71459384e892b070e1200c/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.026654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03547c-9e97-466e-9718-afcfd9b71c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1f5db3e2424b00bf532c3e0d1864ef, user_id=d06cba07cb71459384e892b070e1200c, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.027590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d3316-94cb-4d28-b559-030596aadce0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.032521 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60a89f-40fc-4744-970d-2067deb7b26a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.032719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60a89f-40fc-4744-970d-2067deb7b26a service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.033102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60a89f-40fc-4744-970d-2067deb7b26a service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.033438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60a89f-40fc-4744-970d-2067deb7b26a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.038218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03547c-9e97-466e-9718-afcfd9b71c8b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.043555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60a89f-40fc-4744-970d-2067deb7b26a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.046128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60a89f-40fc-4744-970d-2067deb7b26a service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.058890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 969/1936] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:27.175241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 968/1937] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:26 2022] PUT /identity/v3/projects/aa1f5db3e2424b00bf532c3e0d1864ef/users/d06cba07cb71459384e892b070e1200c/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:27.176387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60a89f-40fc-4744-970d-2067deb7b26a service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.179124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03547c-9e97-466e-9718-afcfd9b71c8b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.182299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ab60a89f-40fc-4744-970d-2067deb7b26a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:27.201837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60a89f-40fc-4744-970d-2067deb7b26a service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.298612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03547c-9e97-466e-9718-afcfd9b71c8b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.300899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.301654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.302145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.302434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] PATH_INFO: `/v3/projects/97e68d0a3ea949ff94421f1aaba9db96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.304101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e68d0a3ea949ff94421f1aaba9db96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.304399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1e30-6596-48f8-b45b-aeee65abe33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.305336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1e30-6596-48f8-b45b-aeee65abe33d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.305695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1e30-6596-48f8-b45b-aeee65abe33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.305983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.306076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1e30-6596-48f8-b45b-aeee65abe33d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.306927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1e30-6596-48f8-b45b-aeee65abe33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.308635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1e30-6596-48f8-b45b-aeee65abe33d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.327271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 969/1938] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:21:27.335004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1e30-6596-48f8-b45b-aeee65abe33d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.341842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1e30-6596-48f8-b45b-aeee65abe33d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.347730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4321d8b-fe3f-4ef6-8f1d-25be1b5152f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.348522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4321d8b-fe3f-4ef6-8f1d-25be1b5152f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.348816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4321d8b-fe3f-4ef6-8f1d-25be1b5152f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.349070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4321d8b-fe3f-4ef6-8f1d-25be1b5152f2 admin admin] PATH_INFO: `/v3/projects/aa1f5db3e2424b00bf532c3e0d1864ef/users/d06cba07cb71459384e892b070e1200c/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.351048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4321d8b-fe3f-4ef6-8f1d-25be1b5152f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1f5db3e2424b00bf532c3e0d1864ef, user_id=d06cba07cb71459384e892b070e1200c, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.353907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4321d8b-fe3f-4ef6-8f1d-25be1b5152f2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.364615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 970/1939] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:27 2022] PUT /identity/v3/projects/aa1f5db3e2424b00bf532c3e0d1864ef/users/d06cba07cb71459384e892b070e1200c/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:27.379670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e48bb-5959-4494-a1b8-fceba926f11e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.379670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e48bb-5959-4494-a1b8-fceba926f11e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.379670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e48bb-5959-4494-a1b8-fceba926f11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.413137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-bc6e48bb-5959-4494-a1b8-fceba926f11e None None] MFA Rules not processed for user `d06cba07cb71459384e892b070e1200c`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:27.414392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bc6e48bb-5959-4494-a1b8-fceba926f11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:27.426019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e68d0a3ea949ff94421f1aaba9db96', 'request_id': 'req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.433389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e68d0a3ea949ff94421f1aaba9db96', 'request_id': 'req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.441338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e68d0a3ea949ff94421f1aaba9db96', 'request_id': 'req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.489294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 971/1940] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:27.542877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] The token cache is being invalidate because project 97e68d0a3ea949ff94421f1aaba9db96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:27.543168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.543946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.545783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 970/1941] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:27 2022] DELETE /identity/v3/projects/97e68d0a3ea949ff94421f1aaba9db96 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:27.549656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e48bb-5959-4494-a1b8-fceba926f11e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.615288 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e48bb-5959-4494-a1b8-fceba926f11e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.620319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.620960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.621239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.621514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] PATH_INFO: `/v3/users/cd79a29800494ec7858f53c0ae06d575` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.622779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd79a29800494ec7858f53c0ae06d575)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.624989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.745256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:27.750499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:27.831301 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cde00e-a72e-44ef-97ee-3ff5fabf1cdb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:27.835152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:27.835736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:27.836038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:27.836292 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:27.838026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:27.885508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd79a29800494ec7858f53c0ae06d575'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.916370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd79a29800494ec7858f53c0ae06d575'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.931627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:27.932864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:27.940010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd79a29800494ec7858f53c0ae06d575'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.940742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd79a29800494ec7858f53c0ae06d575'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.941494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd79a29800494ec7858f53c0ae06d575'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:27.943837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 971/1942] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:28.109728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 972/1943] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:27 2022] DELETE /identity/v3/users/cd79a29800494ec7858f53c0ae06d575 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:28.380728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:28.382221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:28.398747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b37aa-80e2-4bb1-b047-63de0a1dc72f service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.453314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.454004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.454355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.454702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.456495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:28.547164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.548725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.559315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 972/1944] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:28.615008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:28.616743 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:28.699029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b460e1-4064-4932-825f-a91f8732c311 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.711803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.713328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.713684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.714025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] PATH_INFO: `/v3/projects/e8784011fb0b4bc8bf66ebc8cec3ff75` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.715988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8784011fb0b4bc8bf66ebc8cec3ff75)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:28.718391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:28.778306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:28.888131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8784011fb0b4bc8bf66ebc8cec3ff75', 'request_id': 'req-1d6d5339-737b-4930-a438-be23339ecf88'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:28.894520 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8784011fb0b4bc8bf66ebc8cec3ff75', 'request_id': 'req-1d6d5339-737b-4930-a438-be23339ecf88'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:28.928205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:28.930473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:28.941056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36861b9-2fc2-4b39-bdfe-513ff7e3de0e service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:28.992029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869d84f-1301-4b76-bdcf-ebea10d6dbbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:28.992558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869d84f-1301-4b76-bdcf-ebea10d6dbbc service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:28.992837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869d84f-1301-4b76-bdcf-ebea10d6dbbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:28.993111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869d84f-1301-4b76-bdcf-ebea10d6dbbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:28.994996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d869d84f-1301-4b76-bdcf-ebea10d6dbbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:28.996551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8784011fb0b4bc8bf66ebc8cec3ff75', 'request_id': 'req-1d6d5339-737b-4930-a438-be23339ecf88'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:29.009766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] The token cache is being invalidate because project e8784011fb0b4bc8bf66ebc8cec3ff75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:29.010598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:29.012238 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d6d5339-737b-4930-a438-be23339ecf88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:29.014295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 973/1945] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:28 2022] DELETE /identity/v3/projects/e8784011fb0b4bc8bf66ebc8cec3ff75 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:29.020886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abd4b7-8321-49a8-946c-b94eff4e68db None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:29.020886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abd4b7-8321-49a8-946c-b94eff4e68db None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:29.021092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abd4b7-8321-49a8-946c-b94eff4e68db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:29.056605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-25abd4b7-8321-49a8-946c-b94eff4e68db None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:29.059204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-25abd4b7-8321-49a8-946c-b94eff4e68db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:29.081094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869d84f-1301-4b76-bdcf-ebea10d6dbbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:29.082711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869d84f-1301-4b76-bdcf-ebea10d6dbbc service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:29.099707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 973/1946] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:21:29.173221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:29.174785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 974/1947] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:29.183376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050c3a5-a9e1-4510-8864-3fcdd2c3c5a2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:29.183662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050c3a5-a9e1-4510-8864-3fcdd2c3c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:29.184197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050c3a5-a9e1-4510-8864-3fcdd2c3c5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:29.205647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9050c3a5-a9e1-4510-8864-3fcdd2c3c5a2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:29.207000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9050c3a5-a9e1-4510-8864-3fcdd2c3c5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:29.217781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 974/1948] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:29.222311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abd4b7-8321-49a8-946c-b94eff4e68db None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:29.232157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abd4b7-8321-49a8-946c-b94eff4e68db None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:29.237526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538787-9824-4702-8bcf-acfb893ef576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:29.238159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538787-9824-4702-8bcf-acfb893ef576 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:29.238468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538787-9824-4702-8bcf-acfb893ef576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:29.238733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538787-9824-4702-8bcf-acfb893ef576 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:29.239447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538787-9824-4702-8bcf-acfb893ef576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:29.239775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538787-9824-4702-8bcf-acfb893ef576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:29.241336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538787-9824-4702-8bcf-acfb893ef576 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:29.256664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 975/1949] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:29.258059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050c3a5-a9e1-4510-8864-3fcdd2c3c5a2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:29.267836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050c3a5-a9e1-4510-8864-3fcdd2c3c5a2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:29.272672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae914-d992-41ec-ae07-3801c63ed363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:29.273284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae914-d992-41ec-ae07-3801c63ed363 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:29.273559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae914-d992-41ec-ae07-3801c63ed363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:29.273831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae914-d992-41ec-ae07-3801c63ed363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:29.274536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ae914-d992-41ec-ae07-3801c63ed363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:29.276512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ae914-d992-41ec-ae07-3801c63ed363 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:29.396423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 975/1950] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:29 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:29.397267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538787-9824-4702-8bcf-acfb893ef576 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:29.408680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538787-9824-4702-8bcf-acfb893ef576 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:29.475578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ca94-eb44-4dbc-8eda-240071c50187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:29.476240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ca94-eb44-4dbc-8eda-240071c50187 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:29.476518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ca94-eb44-4dbc-8eda-240071c50187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:29.476788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ca94-eb44-4dbc-8eda-240071c50187 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:29.477439 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0ca94-eb44-4dbc-8eda-240071c50187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:29.479438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0ca94-eb44-4dbc-8eda-240071c50187 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:29.571950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 976/1951] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:29 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:29.573111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae914-d992-41ec-ae07-3801c63ed363 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:29.585619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae914-d992-41ec-ae07-3801c63ed363 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:29.590980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396de90-93e8-4891-847c-17c903f0f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:29.591565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396de90-93e8-4891-847c-17c903f0f600 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:29.592648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396de90-93e8-4891-847c-17c903f0f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:29.592914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396de90-93e8-4891-847c-17c903f0f600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:29.593775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396de90-93e8-4891-847c-17c903f0f600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:29.595634 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396de90-93e8-4891-847c-17c903f0f600 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:29.609099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 976/1952] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:29.613346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ca94-eb44-4dbc-8eda-240071c50187 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:29.624132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ca94-eb44-4dbc-8eda-240071c50187 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:29.628690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a2809-7e61-416a-a0a4-ee682f27894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:29.629286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a2809-7e61-416a-a0a4-ee682f27894a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:29.629562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a2809-7e61-416a-a0a4-ee682f27894a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:29.629837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a2809-7e61-416a-a0a4-ee682f27894a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:29.630483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a2809-7e61-416a-a0a4-ee682f27894a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:29.632120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a2809-7e61-416a-a0a4-ee682f27894a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:29.646623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 977/1953] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:29.648254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396de90-93e8-4891-847c-17c903f0f600 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:29.665582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396de90-93e8-4891-847c-17c903f0f600 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:29.672345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac91794-764b-41a6-9bb3-4b9ced792c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:29.673191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac91794-764b-41a6-9bb3-4b9ced792c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:29.674289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac91794-764b-41a6-9bb3-4b9ced792c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:29.674289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac91794-764b-41a6-9bb3-4b9ced792c64 admin admin] PATH_INFO: `/v3/projects/19365d9da6554c4cba2b2f7aeadce6f5/users/fe5ff7c0995b447f933379539c4cf0c9/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:29.694660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac91794-764b-41a6-9bb3-4b9ced792c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19365d9da6554c4cba2b2f7aeadce6f5, user_id=fe5ff7c0995b447f933379539c4cf0c9, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:29.697488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac91794-764b-41a6-9bb3-4b9ced792c64 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:29.888114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 977/1954] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:29 2022] PUT /identity/v3/projects/19365d9da6554c4cba2b2f7aeadce6f5/users/fe5ff7c0995b447f933379539c4cf0c9/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:29.896520 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456af39-1d2c-41e3-a0ea-86ed445fa666 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:29.897505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456af39-1d2c-41e3-a0ea-86ed445fa666 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:29.897789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456af39-1d2c-41e3-a0ea-86ed445fa666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:29.941866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8456af39-1d2c-41e3-a0ea-86ed445fa666 None None] MFA Rules not processed for user `fe5ff7c0995b447f933379539c4cf0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:29.943799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8456af39-1d2c-41e3-a0ea-86ed445fa666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:30.035803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 978/1955] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:30.091121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac91794-764b-41a6-9bb3-4b9ced792c64 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:30.093411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0ac91794-764b-41a6-9bb3-4b9ced792c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:30.176735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac91794-764b-41a6-9bb3-4b9ced792c64 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:30.182200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614d136-b649-43ce-b823-c2f6eccb8f84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:30.182879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d136-b649-43ce-b823-c2f6eccb8f84 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:30.183334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d136-b649-43ce-b823-c2f6eccb8f84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:30.183782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d136-b649-43ce-b823-c2f6eccb8f84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:30.198198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614d136-b649-43ce-b823-c2f6eccb8f84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:30.200370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614d136-b649-43ce-b823-c2f6eccb8f84 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:30.211566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 978/1956] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:21:30.245535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456af39-1d2c-41e3-a0ea-86ed445fa666 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:30.351490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456af39-1d2c-41e3-a0ea-86ed445fa666 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:30.364506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:30.365454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:30.365744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:30.366023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] PATH_INFO: `/v3/users/fe5ff7c0995b447f933379539c4cf0c9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:30.367374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5ff7c0995b447f933379539c4cf0c9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:30.371897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:30.568134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5ff7c0995b447f933379539c4cf0c9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:30.576997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5ff7c0995b447f933379539c4cf0c9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:30.596508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5ff7c0995b447f933379539c4cf0c9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:30.597405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5ff7c0995b447f933379539c4cf0c9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:30.598081 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5ff7c0995b447f933379539c4cf0c9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:30.682080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 979/1957] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:30 2022] DELETE /identity/v3/users/fe5ff7c0995b447f933379539c4cf0c9 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:30.687604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd166-0b02-4955-b562-c20893e1e6af None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:30.688147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd166-0b02-4955-b562-c20893e1e6af None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:30.688332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd166-0b02-4955-b562-c20893e1e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:30.716852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8a8bd166-0b02-4955-b562-c20893e1e6af None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:30.718368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8a8bd166-0b02-4955-b562-c20893e1e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:30.837701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 979/1958] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:30.855858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:30.856660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:30.932251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090fb3d-88fd-4cd7-a9ff-b1cbdfed4037 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:30.939449 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b2053-2dd1-4049-848b-0923f048b1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:30.942922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b2053-2dd1-4049-848b-0923f048b1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:30.942922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b2053-2dd1-4049-848b-0923f048b1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:30.942922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b2053-2dd1-4049-848b-0923f048b1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:30.954253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b2053-2dd1-4049-848b-0923f048b1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:30.955701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b2053-2dd1-4049-848b-0923f048b1f2 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:30.966102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 980/1959] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:21:31.181270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de956f-4c47-4526-b34b-ef10278a86a1 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.181555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de956f-4c47-4526-b34b-ef10278a86a1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.181825 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de956f-4c47-4526-b34b-ef10278a86a1 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.183998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 980/1960] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:21:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:21:31.193192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa9724-32c0-46ac-b8ed-3ae45aa6f74e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.193489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa9724-32c0-46ac-b8ed-3ae45aa6f74e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.193970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa9724-32c0-46ac-b8ed-3ae45aa6f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.224589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d4fa9724-32c0-46ac-b8ed-3ae45aa6f74e None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:31.225829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d4fa9724-32c0-46ac-b8ed-3ae45aa6f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:31.335602 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 981/1961] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:21:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:31.361603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de956f-4c47-4526-b34b-ef10278a86a1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:31.365697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e3de956f-4c47-4526-b34b-ef10278a86a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:31.389898 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de956f-4c47-4526-b34b-ef10278a86a1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:31.395852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c319-64dd-4a8a-8ec6-6f86085c8502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:31.397915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c319-64dd-4a8a-8ec6-6f86085c8502 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.397915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c319-64dd-4a8a-8ec6-6f86085c8502 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.397915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c319-64dd-4a8a-8ec6-6f86085c8502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.407980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c319-64dd-4a8a-8ec6-6f86085c8502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:31.409722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c319-64dd-4a8a-8ec6-6f86085c8502 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:31.422720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 981/1962] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:31.628904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa9724-32c0-46ac-b8ed-3ae45aa6f74e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:31.630720 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d4fa9724-32c0-46ac-b8ed-3ae45aa6f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:31.668928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa9724-32c0-46ac-b8ed-3ae45aa6f74e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:31.676130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:31.677866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:31.678934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:31.680229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] PATH_INFO: `/v3/projects/19365d9da6554c4cba2b2f7aeadce6f5` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:31.682247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] RBAC: Authorizing `identity:delete_project(project_id=19365d9da6554c4cba2b2f7aeadce6f5)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:31.687993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:31.774586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:31.871343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19365d9da6554c4cba2b2f7aeadce6f5', 'request_id': 'req-eec01408-88ba-4bf6-9317-375d0e1ac74c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:31.881687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19365d9da6554c4cba2b2f7aeadce6f5', 'request_id': 'req-eec01408-88ba-4bf6-9317-375d0e1ac74c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:32.053877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19365d9da6554c4cba2b2f7aeadce6f5', 'request_id': 'req-eec01408-88ba-4bf6-9317-375d0e1ac74c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:32.088843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] The token cache is being invalidate because project 19365d9da6554c4cba2b2f7aeadce6f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:32.091137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:32.094115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-eec01408-88ba-4bf6-9317-375d0e1ac74c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:32.100531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 982/1963] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:31 2022] DELETE /identity/v3/projects/19365d9da6554c4cba2b2f7aeadce6f5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:32.106050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bb495-e3eb-44a0-8386-b9e89df1d50b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.106869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bb495-e3eb-44a0-8386-b9e89df1d50b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.108473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bb495-e3eb-44a0-8386-b9e89df1d50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.137971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-762bb495-e3eb-44a0-8386-b9e89df1d50b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:32.140548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-762bb495-e3eb-44a0-8386-b9e89df1d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:32.163790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:32.265719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 982/1964] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:32.277054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15536a47-45ea-490a-ac41-356538ac42e2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.277344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15536a47-45ea-490a-ac41-356538ac42e2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.277646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15536a47-45ea-490a-ac41-356538ac42e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.304359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-15536a47-45ea-490a-ac41-356538ac42e2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:32.305539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-15536a47-45ea-490a-ac41-356538ac42e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:32.317620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 983/1965] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:32.322604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bb495-e3eb-44a0-8386-b9e89df1d50b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.335407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bb495-e3eb-44a0-8386-b9e89df1d50b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.340347 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a05ecb-e8ab-4fbf-b366-c100556db78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.340995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a05ecb-e8ab-4fbf-b366-c100556db78f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.341316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a05ecb-e8ab-4fbf-b366-c100556db78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.341572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a05ecb-e8ab-4fbf-b366-c100556db78f admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.342265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a05ecb-e8ab-4fbf-b366-c100556db78f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:32.342566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a05ecb-e8ab-4fbf-b366-c100556db78f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.344264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a05ecb-e8ab-4fbf-b366-c100556db78f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.356883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 983/1966] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:32.361795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15536a47-45ea-490a-ac41-356538ac42e2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.371403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15536a47-45ea-490a-ac41-356538ac42e2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.377615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e7a2f-781f-47c1-840b-1b1e8a979869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.382507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e7a2f-781f-47c1-840b-1b1e8a979869 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.382507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e7a2f-781f-47c1-840b-1b1e8a979869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.382507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e7a2f-781f-47c1-840b-1b1e8a979869 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.382507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e7a2f-781f-47c1-840b-1b1e8a979869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.382507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e7a2f-781f-47c1-840b-1b1e8a979869 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.505461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 984/1967] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:32.509742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a05ecb-e8ab-4fbf-b366-c100556db78f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.520951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a05ecb-e8ab-4fbf-b366-c100556db78f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.585784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7b125-007b-404e-b770-e4ce7d0b36d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.586395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b125-007b-404e-b770-e4ce7d0b36d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.586669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b125-007b-404e-b770-e4ce7d0b36d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.586942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b125-007b-404e-b770-e4ce7d0b36d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.587579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7b125-007b-404e-b770-e4ce7d0b36d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.589694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7b125-007b-404e-b770-e4ce7d0b36d0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.732408 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 984/1968] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:32.737237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e7a2f-781f-47c1-840b-1b1e8a979869 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.748057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e7a2f-781f-47c1-840b-1b1e8a979869 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.753538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffc99f-55bf-4879-95bc-e34facda75ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.754347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffc99f-55bf-4879-95bc-e34facda75ec admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.754626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffc99f-55bf-4879-95bc-e34facda75ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.754900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffc99f-55bf-4879-95bc-e34facda75ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.755562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffc99f-55bf-4879-95bc-e34facda75ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.757260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffc99f-55bf-4879-95bc-e34facda75ec admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.771601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 985/1969] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:21:32.772822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7b125-007b-404e-b770-e4ce7d0b36d0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.783657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7b125-007b-404e-b770-e4ce7d0b36d0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.788769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634b299-fb84-4550-b26f-02370a69a3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.789386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634b299-fb84-4550-b26f-02370a69a3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.789665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634b299-fb84-4550-b26f-02370a69a3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.790121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634b299-fb84-4550-b26f-02370a69a3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.790787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634b299-fb84-4550-b26f-02370a69a3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.792515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634b299-fb84-4550-b26f-02370a69a3cb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.805366 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 985/1970] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:32.809324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffc99f-55bf-4879-95bc-e34facda75ec admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:32.819662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffc99f-55bf-4879-95bc-e34facda75ec admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:32.824251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9a3a4-5fe8-489f-9083-12c1a48c2f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:32.824895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9a3a4-5fe8-489f-9083-12c1a48c2f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.825174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9a3a4-5fe8-489f-9083-12c1a48c2f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.825444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9a3a4-5fe8-489f-9083-12c1a48c2f5a admin admin] PATH_INFO: `/v3/projects/3959681d128b4073b597793bc224f819/users/58a762e958144f0bb9cf0a9ab5a91032/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.840686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9a3a4-5fe8-489f-9083-12c1a48c2f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3959681d128b4073b597793bc224f819, user_id=58a762e958144f0bb9cf0a9ab5a91032, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:32.844154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9a3a4-5fe8-489f-9083-12c1a48c2f5a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:32.962295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 986/1971] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:32 2022] PUT /identity/v3/projects/3959681d128b4073b597793bc224f819/users/58a762e958144f0bb9cf0a9ab5a91032/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:32.968425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23879c17-4cfc-48ed-b69a-f36902765f08 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:32.968425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23879c17-4cfc-48ed-b69a-f36902765f08 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:32.968425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23879c17-4cfc-48ed-b69a-f36902765f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:32.987646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-23879c17-4cfc-48ed-b69a-f36902765f08 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:32.989354 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-23879c17-4cfc-48ed-b69a-f36902765f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:33.051260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 986/1972] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:33.061853 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9a3a4-5fe8-489f-9083-12c1a48c2f5a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:33.063713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-05d9a3a4-5fe8-489f-9083-12c1a48c2f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:33.121093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9a3a4-5fe8-489f-9083-12c1a48c2f5a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:33.126649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb5704-db40-4a91-aa5c-847f39dd9409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:33.127272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5704-db40-4a91-aa5c-847f39dd9409 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:33.127555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5704-db40-4a91-aa5c-847f39dd9409 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:33.127867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5704-db40-4a91-aa5c-847f39dd9409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:33.137610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5704-db40-4a91-aa5c-847f39dd9409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:33.139458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5704-db40-4a91-aa5c-847f39dd9409 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:33.151681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 987/1973] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:34.212944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:34.298483 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:34.647145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:35.007107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.226785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:36.304206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:37.422420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.083212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.824672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:38.977942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23879c17-4cfc-48ed-b69a-f36902765f08 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:38.979395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-23879c17-4cfc-48ed-b69a-f36902765f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:38.993470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23879c17-4cfc-48ed-b69a-f36902765f08 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.004242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.004957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.005235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.005953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] PATH_INFO: `/v3/users/30df50e776674863b4a2ae9b11148a66` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.007276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30df50e776674863b4a2ae9b11148a66)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.009571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:39.366695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30df50e776674863b4a2ae9b11148a66'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:39.368607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30df50e776674863b4a2ae9b11148a66'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:39.487376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30df50e776674863b4a2ae9b11148a66'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:39.488153 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30df50e776674863b4a2ae9b11148a66'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:39.519805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30df50e776674863b4a2ae9b11148a66'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:39.545511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 987/1974] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:38 2022] DELETE /identity/v3/users/30df50e776674863b4a2ae9b11148a66 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:39.550172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2aa32-d974-40fc-8504-8c377708d0c5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.550459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2aa32-d974-40fc-8504-8c377708d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.550739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2aa32-d974-40fc-8504-8c377708d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.589319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-96e2aa32-d974-40fc-8504-8c377708d0c5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:39.594753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-96e2aa32-d974-40fc-8504-8c377708d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:39.741898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 988/1975] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:39.757194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:39.758800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:39.890783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6bc57-6969-48a3-b671-ab4eff9ac8f2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:39.900681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f86cc9-578f-4409-a9d0-a280636ca19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:39.901690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86cc9-578f-4409-a9d0-a280636ca19c service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:39.902186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86cc9-578f-4409-a9d0-a280636ca19c service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:39.902828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86cc9-578f-4409-a9d0-a280636ca19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:39.921372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f86cc9-578f-4409-a9d0-a280636ca19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:39.944569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f86cc9-578f-4409-a9d0-a280636ca19c service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.008161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 988/1976] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:40.136150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:40.263167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ed47-c661-4614-a0e6-65b916bdeda2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.264181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ed47-c661-4614-a0e6-65b916bdeda2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.264605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260ed47-c661-4614-a0e6-65b916bdeda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.312892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9260ed47-c661-4614-a0e6-65b916bdeda2 None None] MFA Rules not processed for user `58a762e958144f0bb9cf0a9ab5a91032`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:40.314797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9260ed47-c661-4614-a0e6-65b916bdeda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:40.398094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 989/1977] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:40.402610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f86cc9-578f-4409-a9d0-a280636ca19c service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.404852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f8f86cc9-578f-4409-a9d0-a280636ca19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:40.418172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f86cc9-578f-4409-a9d0-a280636ca19c service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.431146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a163f-d003-43b1-80e1-44ca2e65b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.431815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a163f-d003-43b1-80e1-44ca2e65b977 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.432102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a163f-d003-43b1-80e1-44ca2e65b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.432383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a163f-d003-43b1-80e1-44ca2e65b977 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.433292 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a163f-d003-43b1-80e1-44ca2e65b977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.436623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a163f-d003-43b1-80e1-44ca2e65b977 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.542258 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 989/1978] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:40 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:40.546994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260ed47-c661-4614-a0e6-65b916bdeda2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.564718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260ed47-c661-4614-a0e6-65b916bdeda2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.753581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c2a5f-4f68-4aee-bc60-d90f5aa2145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.754470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c2a5f-4f68-4aee-bc60-d90f5aa2145c admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.754898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c2a5f-4f68-4aee-bc60-d90f5aa2145c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.755487 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c2a5f-4f68-4aee-bc60-d90f5aa2145c admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.756525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c2a5f-4f68-4aee-bc60-d90f5aa2145c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.761279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c2a5f-4f68-4aee-bc60-d90f5aa2145c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.909631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 990/1979] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:40 2022] POST /identity/v3/users => generated 298 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:40.913713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a163f-d003-43b1-80e1-44ca2e65b977 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.926246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a163f-d003-43b1-80e1-44ca2e65b977 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.933989 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b12347-b53b-4597-8390-7b228355a40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.934722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12347-b53b-4597-8390-7b228355a40b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.935063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12347-b53b-4597-8390-7b228355a40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.937602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12347-b53b-4597-8390-7b228355a40b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.938360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b12347-b53b-4597-8390-7b228355a40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.940094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b12347-b53b-4597-8390-7b228355a40b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:40.952070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 990/1980] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:40.956657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c2a5f-4f68-4aee-bc60-d90f5aa2145c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.961579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ff6c2a5f-4f68-4aee-bc60-d90f5aa2145c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:40.978646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c2a5f-4f68-4aee-bc60-d90f5aa2145c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:40.994770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b12347-b53b-4597-8390-7b228355a40b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:40.995262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:40.995262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:40.995262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:40.995262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] PATH_INFO: `/v3/projects/cbf812d7f6804f329b538b8124fdf982` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:40.995577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf812d7f6804f329b538b8124fdf982)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:40.995577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:41.000952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b12347-b53b-4597-8390-7b228355a40b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:41.013601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b653d4-cbc4-4856-99b3-9fe856a018ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:41.019959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b653d4-cbc4-4856-99b3-9fe856a018ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:41.021080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b653d4-cbc4-4856-99b3-9fe856a018ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:41.021446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b653d4-cbc4-4856-99b3-9fe856a018ec admin admin] PATH_INFO: `/v3/projects/a71f0a772e554303b4c3c964626e1061/users/e1e3509323f34441a2b9d9b39dddaa61/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:41.041993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b653d4-cbc4-4856-99b3-9fe856a018ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71f0a772e554303b4c3c964626e1061, user_id=e1e3509323f34441a2b9d9b39dddaa61, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:41.045345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b653d4-cbc4-4856-99b3-9fe856a018ec admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:41.180712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 991/1981] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:40 2022] PUT /identity/v3/projects/a71f0a772e554303b4c3c964626e1061/users/e1e3509323f34441a2b9d9b39dddaa61/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:41.186984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b653d4-cbc4-4856-99b3-9fe856a018ec admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:41.192362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf812d7f6804f329b538b8124fdf982', 'request_id': 'req-fe1d3c4c-2c92-48ae-9851-bbd20075876c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.199895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf812d7f6804f329b538b8124fdf982', 'request_id': 'req-fe1d3c4c-2c92-48ae-9851-bbd20075876c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.291382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b653d4-cbc4-4856-99b3-9fe856a018ec admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:41.353812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c858c-b445-41b7-aedc-8e5059f2c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:41.354467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c858c-b445-41b7-aedc-8e5059f2c6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:41.354751 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c858c-b445-41b7-aedc-8e5059f2c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:41.355032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c858c-b445-41b7-aedc-8e5059f2c6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:41.355766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c858c-b445-41b7-aedc-8e5059f2c6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:41.357242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf812d7f6804f329b538b8124fdf982', 'request_id': 'req-fe1d3c4c-2c92-48ae-9851-bbd20075876c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.357812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c858c-b445-41b7-aedc-8e5059f2c6d7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:41.370602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 992/1982] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:21:41.376982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c858c-b445-41b7-aedc-8e5059f2c6d7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:41.384725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] The token cache is being invalidate because project cbf812d7f6804f329b538b8124fdf982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:41.384910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.386592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.390446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 991/1983] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:40 2022] DELETE /identity/v3/projects/cbf812d7f6804f329b538b8124fdf982 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:41.393486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c858c-b445-41b7-aedc-8e5059f2c6d7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:41.395206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:41.397097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:41.399825 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb286f-b02d-4d0b-a8c7-35d82c4ffba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:41.401158 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb286f-b02d-4d0b-a8c7-35d82c4ffba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:41.401445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb286f-b02d-4d0b-a8c7-35d82c4ffba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:41.401725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb286f-b02d-4d0b-a8c7-35d82c4ffba8 admin admin] PATH_INFO: `/v3/projects/a71f0a772e554303b4c3c964626e1061/users/e1e3509323f34441a2b9d9b39dddaa61/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:41.405242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb286f-b02d-4d0b-a8c7-35d82c4ffba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71f0a772e554303b4c3c964626e1061, user_id=e1e3509323f34441a2b9d9b39dddaa61, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:41.412120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb286f-b02d-4d0b-a8c7-35d82c4ffba8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:41.415016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:41.421072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d3c4c-2c92-48ae-9851-bbd20075876c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:41.435006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 993/1984] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:41 2022] PUT /identity/v3/projects/a71f0a772e554303b4c3c964626e1061/users/e1e3509323f34441a2b9d9b39dddaa61/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:41.495210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:41.495827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:41.496113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:41.496387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] PATH_INFO: `/v3/users/6f597e63609c484da7b7735556550475` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:41.497623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f597e63609c484da7b7735556550475)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:41.500931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:41.697105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f597e63609c484da7b7735556550475'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.704401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f597e63609c484da7b7735556550475'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.719438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f597e63609c484da7b7735556550475'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.720271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f597e63609c484da7b7735556550475'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.720885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f597e63609c484da7b7735556550475'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:41.805948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 992/1985] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:41 2022] DELETE /identity/v3/users/6f597e63609c484da7b7735556550475 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:42.189688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:42.408615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb286f-b02d-4d0b-a8c7-35d82c4ffba8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:42.410948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-06cb286f-b02d-4d0b-a8c7-35d82c4ffba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:42.429002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb286f-b02d-4d0b-a8c7-35d82c4ffba8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:42.490802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:42.491584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:42.492039 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:42.492384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] PATH_INFO: `/v3/users/651874600ac94b319ecf7d56714d7116` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:42.493983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651874600ac94b319ecf7d56714d7116)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:42.496116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:42.538198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:42.539765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:42.562097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcada1a-0c28-4ede-8cfc-354b997a7540 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:42.568305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:42.569010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:42.569299 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:42.569599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] PATH_INFO: `/v3/projects/0eaac4c86d65466391d0a73411bafce8` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:42.575373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eaac4c86d65466391d0a73411bafce8)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:42.578900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:42.641759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:42.725515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651874600ac94b319ecf7d56714d7116'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:42.726761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651874600ac94b319ecf7d56714d7116'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:42.726994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eaac4c86d65466391d0a73411bafce8', 'request_id': 'req-888d9417-36bc-41a2-bce0-4f7d70ed24fe'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:42.735930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eaac4c86d65466391d0a73411bafce8', 'request_id': 'req-888d9417-36bc-41a2-bce0-4f7d70ed24fe'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:42.877961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651874600ac94b319ecf7d56714d7116'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:42.881476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651874600ac94b319ecf7d56714d7116'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:42.904651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e68a6e51-ffab-4cc4-b821-70c72d7cda65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651874600ac94b319ecf7d56714d7116'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:42.926228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 994/1986] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:42 2022] DELETE /identity/v3/users/651874600ac94b319ecf7d56714d7116 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:42.932220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7238-9b6c-47fd-9276-9e30a8b0aa8c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:42.932576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7238-9b6c-47fd-9276-9e30a8b0aa8c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:42.939361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7238-9b6c-47fd-9276-9e30a8b0aa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:42.954678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2d2b7238-9b6c-47fd-9276-9e30a8b0aa8c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:42.955938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2d2b7238-9b6c-47fd-9276-9e30a8b0aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:42.994823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eaac4c86d65466391d0a73411bafce8', 'request_id': 'req-888d9417-36bc-41a2-bce0-4f7d70ed24fe'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:43.006756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] The token cache is being invalidate because project 0eaac4c86d65466391d0a73411bafce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:43.007470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:43.022665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 995/1987] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:43.022947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-888d9417-36bc-41a2-bce0-4f7d70ed24fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:43.025361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 993/1988] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:42 2022] DELETE /identity/v3/projects/0eaac4c86d65466391d0a73411bafce8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:43.029912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b7238-9b6c-47fd-9276-9e30a8b0aa8c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.031028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a199f-10df-4e1e-bb1e-4aae50b559c6 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.031323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2d2b7238-9b6c-47fd-9276-9e30a8b0aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:43.031523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a199f-10df-4e1e-bb1e-4aae50b559c6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.031848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a199f-10df-4e1e-bb1e-4aae50b559c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.093521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-381a199f-10df-4e1e-bb1e-4aae50b559c6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:43.094764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-381a199f-10df-4e1e-bb1e-4aae50b559c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:43.112987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 994/1989] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:43.120506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb0ee-f0f1-4d7f-84f9-a5b72b35f7ed None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.120796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb0ee-f0f1-4d7f-84f9-a5b72b35f7ed None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.121072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb0ee-f0f1-4d7f-84f9-a5b72b35f7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.122182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b7238-9b6c-47fd-9276-9e30a8b0aa8c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.133753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5da3b-b3be-4b01-8b08-8c34c83d8e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.135115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5da3b-b3be-4b01-8b08-8c34c83d8e36 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.135763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5da3b-b3be-4b01-8b08-8c34c83d8e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.136315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5da3b-b3be-4b01-8b08-8c34c83d8e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.139854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-14f5da3b-b3be-4b01-8b08-8c34c83d8e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:43.152644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ed5fb0ee-f0f1-4d7f-84f9-a5b72b35f7ed None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:43.155106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ed5fb0ee-f0f1-4d7f-84f9-a5b72b35f7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:43.164542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 995/1990] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:43.169242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb0ee-f0f1-4d7f-84f9-a5b72b35f7ed None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.177611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5da3b-b3be-4b01-8b08-8c34c83d8e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.179389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5da3b-b3be-4b01-8b08-8c34c83d8e36 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.179670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb0ee-f0f1-4d7f-84f9-a5b72b35f7ed None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.189793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cee621-b8c6-402f-b41b-493663b6f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.189793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cee621-b8c6-402f-b41b-493663b6f5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.189793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cee621-b8c6-402f-b41b-493663b6f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.190568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cee621-b8c6-402f-b41b-493663b6f5fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.191437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cee621-b8c6-402f-b41b-493663b6f5fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:43.191925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cee621-b8c6-402f-b41b-493663b6f5fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.194224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cee621-b8c6-402f-b41b-493663b6f5fb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.207905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 996/1991] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:43.218672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 996/1992] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:43.224580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5da3b-b3be-4b01-8b08-8c34c83d8e36 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.241729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5da3b-b3be-4b01-8b08-8c34c83d8e36 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.256274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92af87c-dc32-4491-98ae-e9261788cb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.256924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92af87c-dc32-4491-98ae-e9261788cb91 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.257207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92af87c-dc32-4491-98ae-e9261788cb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.257482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92af87c-dc32-4491-98ae-e9261788cb91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.258191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92af87c-dc32-4491-98ae-e9261788cb91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.264210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92af87c-dc32-4491-98ae-e9261788cb91 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.423917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 997/1993] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:43 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:43.428711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cee621-b8c6-402f-b41b-493663b6f5fb admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.452537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cee621-b8c6-402f-b41b-493663b6f5fb admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.546118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:43.552267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585e8be-96a6-4e25-90e0-671e35a6f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.552894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585e8be-96a6-4e25-90e0-671e35a6f3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.553167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585e8be-96a6-4e25-90e0-671e35a6f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.553445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585e8be-96a6-4e25-90e0-671e35a6f3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.554710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585e8be-96a6-4e25-90e0-671e35a6f3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.557446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585e8be-96a6-4e25-90e0-671e35a6f3b5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.723789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 997/1994] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:43 2022] POST /identity/v3/users => generated 291 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:43.727738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92af87c-dc32-4491-98ae-e9261788cb91 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.739495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92af87c-dc32-4491-98ae-e9261788cb91 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.744487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ef724-5a24-4779-b5be-7904bafe71ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.745328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ef724-5a24-4779-b5be-7904bafe71ae admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.745775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ef724-5a24-4779-b5be-7904bafe71ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.746190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ef724-5a24-4779-b5be-7904bafe71ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.747093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ef724-5a24-4779-b5be-7904bafe71ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.749193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ef724-5a24-4779-b5be-7904bafe71ae admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.760678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 998/1995] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:43.764895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585e8be-96a6-4e25-90e0-671e35a6f3b5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.781275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585e8be-96a6-4e25-90e0-671e35a6f3b5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.794072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0cd87-8e1b-44b0-96c0-0a8aa3b75db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.794072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0cd87-8e1b-44b0-96c0-0a8aa3b75db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.794072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0cd87-8e1b-44b0-96c0-0a8aa3b75db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.794072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0cd87-8e1b-44b0-96c0-0a8aa3b75db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.794480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0cd87-8e1b-44b0-96c0-0a8aa3b75db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.794480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0cd87-8e1b-44b0-96c0-0a8aa3b75db3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.821975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 998/1996] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:43.826728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ef724-5a24-4779-b5be-7904bafe71ae admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.843873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ef724-5a24-4779-b5be-7904bafe71ae admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.849142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0cd87-8e1b-44b0-96c0-0a8aa3b75db3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:43.855612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2db0cd87-8e1b-44b0-96c0-0a8aa3b75db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:43.871537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4f23a-9659-4031-905a-0055ed5e8b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.872276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4f23a-9659-4031-905a-0055ed5e8b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.873479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0cd87-8e1b-44b0-96c0-0a8aa3b75db3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:43.874629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4f23a-9659-4031-905a-0055ed5e8b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.875077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4f23a-9659-4031-905a-0055ed5e8b90 admin admin] PATH_INFO: `/v3/projects/4ec0d0e376464083980b6781c82bb9cf/users/a2f964f481c64dd28c34504fb81240e1/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.886470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:43.887125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:43.887404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:43.887803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] PATH_INFO: `/v3/projects/9203f8d79c524f1486f6e39fc9c5b4cb` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:43.891588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9203f8d79c524f1486f6e39fc9c5b4cb)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.893583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:43.935837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4f23a-9659-4031-905a-0055ed5e8b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec0d0e376464083980b6781c82bb9cf, user_id=a2f964f481c64dd28c34504fb81240e1, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:43.942062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4f23a-9659-4031-905a-0055ed5e8b90 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.056576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 999/1997] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:43 2022] PUT /identity/v3/projects/4ec0d0e376464083980b6781c82bb9cf/users/a2f964f481c64dd28c34504fb81240e1/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:44.076631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9476-c4f4-4f9d-9e12-6014e903feb6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.083488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9476-c4f4-4f9d-9e12-6014e903feb6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.083488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9476-c4f4-4f9d-9e12-6014e903feb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.110927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9203f8d79c524f1486f6e39fc9c5b4cb', 'request_id': 'req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.126079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9203f8d79c524f1486f6e39fc9c5b4cb', 'request_id': 'req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.128031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e10d9476-c4f4-4f9d-9e12-6014e903feb6 None None] MFA Rules not processed for user `a2f964f481c64dd28c34504fb81240e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:44.132685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e10d9476-c4f4-4f9d-9e12-6014e903feb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:44.240600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9203f8d79c524f1486f6e39fc9c5b4cb', 'request_id': 'req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.270614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1000/1998] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:44.271904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] The token cache is being invalidate because project 9203f8d79c524f1486f6e39fc9c5b4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:44.275033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.276169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9476-c4f4-4f9d-9e12-6014e903feb6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.280953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.283270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 999/1999] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:43 2022] DELETE /identity/v3/projects/9203f8d79c524f1486f6e39fc9c5b4cb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:44.287329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.289950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:44.404802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9476-c4f4-4f9d-9e12-6014e903feb6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.411068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bd1b5-52ee-4a91-8e77-ff83752a154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.419686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3a2a1-e254-4b39-ae6f-fe7e3d4805fe admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.426501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bd1b5-52ee-4a91-8e77-ff83752a154b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.426967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.427066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bd1b5-52ee-4a91-8e77-ff83752a154b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.427066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bd1b5-52ee-4a91-8e77-ff83752a154b admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.427212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.427657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bd1b5-52ee-4a91-8e77-ff83752a154b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.427805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.428070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] PATH_INFO: `/v3/users/d06cba07cb71459384e892b070e1200c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.429274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06cba07cb71459384e892b070e1200c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.431506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.436191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bd1b5-52ee-4a91-8e77-ff83752a154b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.603616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1001/2000] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:44 2022] POST /identity/v3/projects => generated 383 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:44.605539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bd1b5-52ee-4a91-8e77-ff83752a154b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.609398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a76bd1b5-52ee-4a91-8e77-ff83752a154b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:44.702755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06cba07cb71459384e892b070e1200c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.709214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bd1b5-52ee-4a91-8e77-ff83752a154b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:44.711065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06cba07cb71459384e892b070e1200c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.714743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfa911-21f4-41b4-a1a5-449acd716a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:44.715387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfa911-21f4-41b4-a1a5-449acd716a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:44.715837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfa911-21f4-41b4-a1a5-449acd716a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:44.716032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfa911-21f4-41b4-a1a5-449acd716a9a admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:44.716887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfa911-21f4-41b4-a1a5-449acd716a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:44.723939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfa911-21f4-41b4-a1a5-449acd716a9a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:44.734129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06cba07cb71459384e892b070e1200c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.735006 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06cba07cb71459384e892b070e1200c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.735691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06cba07cb71459384e892b070e1200c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:44.835392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1000/2001] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:44 2022] DELETE /identity/v3/users/d06cba07cb71459384e892b070e1200c => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:44.836824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1002/2002] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:44 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:44.847319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:44.854681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:45.046576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9c3ad-d616-4e96-824f-fb232cbe1eb6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.064539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf5503-82f5-4320-9182-7257cb06d12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.065157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf5503-82f5-4320-9182-7257cb06d12c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.065458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf5503-82f5-4320-9182-7257cb06d12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.065712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf5503-82f5-4320-9182-7257cb06d12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.066370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf5503-82f5-4320-9182-7257cb06d12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.068003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf5503-82f5-4320-9182-7257cb06d12c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.091990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1001/2003] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:45.096341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfa911-21f4-41b4-a1a5-449acd716a9a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.105488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.122245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfa911-21f4-41b4-a1a5-449acd716a9a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.127578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cfa05-141d-48e1-8f6a-5a975199ffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.128443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cfa05-141d-48e1-8f6a-5a975199ffa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.128871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cfa05-141d-48e1-8f6a-5a975199ffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.129148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cfa05-141d-48e1-8f6a-5a975199ffa0 admin admin] PATH_INFO: `/v3/projects/2e063616a2b344a3a151e1564fcb682d/users/c6e43a9e9e47428fad2bfdb7bd6bfe07/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.148116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cfa05-141d-48e1-8f6a-5a975199ffa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e063616a2b344a3a151e1564fcb682d, user_id=c6e43a9e9e47428fad2bfdb7bd6bfe07, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.153437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cfa05-141d-48e1-8f6a-5a975199ffa0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.259401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1003/2004] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:45 2022] PUT /identity/v3/projects/2e063616a2b344a3a151e1564fcb682d/users/c6e43a9e9e47428fad2bfdb7bd6bfe07/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:45.263684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf5503-82f5-4320-9182-7257cb06d12c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.287019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf5503-82f5-4320-9182-7257cb06d12c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.315083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:45.392571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d991407-c4e3-40a3-9b49-a09643b857a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.393279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d991407-c4e3-40a3-9b49-a09643b857a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.393677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d991407-c4e3-40a3-9b49-a09643b857a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.394020 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d991407-c4e3-40a3-9b49-a09643b857a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.394741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d991407-c4e3-40a3-9b49-a09643b857a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.396471 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d991407-c4e3-40a3-9b49-a09643b857a5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.411796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1002/2005] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:45.415785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cfa05-141d-48e1-8f6a-5a975199ffa0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.427690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cfa05-141d-48e1-8f6a-5a975199ffa0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.450020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0bf7c-5281-4f10-9353-38ae85450363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.451665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0bf7c-5281-4f10-9353-38ae85450363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.452093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0bf7c-5281-4f10-9353-38ae85450363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.452390 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0bf7c-5281-4f10-9353-38ae85450363 admin admin] PATH_INFO: `/v3/projects/2e063616a2b344a3a151e1564fcb682d/users/c6e43a9e9e47428fad2bfdb7bd6bfe07/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.458009 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0bf7c-5281-4f10-9353-38ae85450363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e063616a2b344a3a151e1564fcb682d, user_id=c6e43a9e9e47428fad2bfdb7bd6bfe07, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.463263 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0bf7c-5281-4f10-9353-38ae85450363 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.499956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1004/2006] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:45 2022] PUT /identity/v3/projects/2e063616a2b344a3a151e1564fcb682d/users/c6e43a9e9e47428fad2bfdb7bd6bfe07/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:45.500710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b285b8-3c78-4358-ba37-8ce83d2a03f4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.501001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b285b8-3c78-4358-ba37-8ce83d2a03f4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.501276 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b285b8-3c78-4358-ba37-8ce83d2a03f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.548305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c1b285b8-3c78-4358-ba37-8ce83d2a03f4 None None] MFA Rules not processed for user `c6e43a9e9e47428fad2bfdb7bd6bfe07`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:45.549925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c1b285b8-3c78-4358-ba37-8ce83d2a03f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:45.702564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1003/2007] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:45.717858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0bf7c-5281-4f10-9353-38ae85450363 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.720075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f3b0bf7c-5281-4f10-9353-38ae85450363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:45.749772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b285b8-3c78-4358-ba37-8ce83d2a03f4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:45.751317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c1b285b8-3c78-4358-ba37-8ce83d2a03f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:45.863904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0bf7c-5281-4f10-9353-38ae85450363 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.868735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b093f82-7b2e-4ce1-9c81-069f789fea21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.870768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b093f82-7b2e-4ce1-9c81-069f789fea21 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.871239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b093f82-7b2e-4ce1-9c81-069f789fea21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.871667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b093f82-7b2e-4ce1-9c81-069f789fea21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.890071 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b093f82-7b2e-4ce1-9c81-069f789fea21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.892473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b093f82-7b2e-4ce1-9c81-069f789fea21 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:45.925109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1005/2008] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:45.960121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b285b8-3c78-4358-ba37-8ce83d2a03f4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:45.967638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:45.968383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:45.969940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:45.970501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] PATH_INFO: `/v3/projects/aa1f5db3e2424b00bf532c3e0d1864ef` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:45.973430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1f5db3e2424b00bf532c3e0d1864ef)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:45.977806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.139416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b093f82-7b2e-4ce1-9c81-069f789fea21 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.151399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b093f82-7b2e-4ce1-9c81-069f789fea21 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.189151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1f5db3e2424b00bf532c3e0d1864ef', 'request_id': 'req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:46.205003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1f5db3e2424b00bf532c3e0d1864ef', 'request_id': 'req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:46.224869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf42ca-fcf4-4dd3-92d7-ea6fd394cf94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.225841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf42ca-fcf4-4dd3-92d7-ea6fd394cf94 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.226266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf42ca-fcf4-4dd3-92d7-ea6fd394cf94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.226727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf42ca-fcf4-4dd3-92d7-ea6fd394cf94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.228902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-33bf42ca-fcf4-4dd3-92d7-ea6fd394cf94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:46.318381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf42ca-fcf4-4dd3-92d7-ea6fd394cf94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.320724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf42ca-fcf4-4dd3-92d7-ea6fd394cf94 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.334902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1006/2009] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:46.337926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1f5db3e2424b00bf532c3e0d1864ef', 'request_id': 'req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:46.354388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] The token cache is being invalidate because project aa1f5db3e2424b00bf532c3e0d1864ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:46.360291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:46.360291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d58b0237-ec6c-4468-b4a4-e3a2acb1b668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:46.364230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1004/2010] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:45 2022] DELETE /identity/v3/projects/aa1f5db3e2424b00bf532c3e0d1864ef => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:46.367868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c341139-4e2e-406e-a2c5-3d0710ec7f97 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.368136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c341139-4e2e-406e-a2c5-3d0710ec7f97 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.368477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c341139-4e2e-406e-a2c5-3d0710ec7f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.396606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7c341139-4e2e-406e-a2c5-3d0710ec7f97 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:46.398229 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7c341139-4e2e-406e-a2c5-3d0710ec7f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:46.567855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1007/2011] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:46.582307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b706da-b610-40a0-aceb-ec6ab53419ef None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.582654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b706da-b610-40a0-aceb-ec6ab53419ef None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.584086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b706da-b610-40a0-aceb-ec6ab53419ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.664127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-08b706da-b610-40a0-aceb-ec6ab53419ef None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:46.668713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-08b706da-b610-40a0-aceb-ec6ab53419ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:46.713302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1005/2012] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:46.716092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c341139-4e2e-406e-a2c5-3d0710ec7f97 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.752554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c341139-4e2e-406e-a2c5-3d0710ec7f97 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.769821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.770668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.771137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.776587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.777503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:46.778000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.784876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.830161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1008/2013] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:46.836594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b706da-b610-40a0-aceb-ec6ab53419ef None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.864228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:46.875811 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b706da-b610-40a0-aceb-ec6ab53419ef None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:46.890035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27979c55-6916-4471-b78d-571ec0dfdbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:46.890810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27979c55-6916-4471-b78d-571ec0dfdbda admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:46.891270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27979c55-6916-4471-b78d-571ec0dfdbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:46.891789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27979c55-6916-4471-b78d-571ec0dfdbda admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:46.892650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27979c55-6916-4471-b78d-571ec0dfdbda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:46.894995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27979c55-6916-4471-b78d-571ec0dfdbda admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:46.983627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:46.986963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:47.001772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77e66-7978-41c2-a436-7e2db8f5ccc0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.007337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.008439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.008949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.009428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] PATH_INFO: `/v3/users/a2f964f481c64dd28c34504fb81240e1` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.011044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f964f481c64dd28c34504fb81240e1)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.013886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.038642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1006/2014] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:46 2022] POST /identity/v3/projects => generated 369 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:47.040118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27979c55-6916-4471-b78d-571ec0dfdbda admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.190696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27979c55-6916-4471-b78d-571ec0dfdbda admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.218036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631a799-4051-4be6-9183-574b533f5310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.223311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631a799-4051-4be6-9183-574b533f5310 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.223949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631a799-4051-4be6-9183-574b533f5310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.224293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631a799-4051-4be6-9183-574b533f5310 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.225003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631a799-4051-4be6-9183-574b533f5310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.227372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631a799-4051-4be6-9183-574b533f5310 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.290905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f964f481c64dd28c34504fb81240e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:47.293869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f964f481c64dd28c34504fb81240e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:47.321973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1007/2015] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:47 2022] POST /identity/v3/users => generated 285 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:21:47.327433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631a799-4051-4be6-9183-574b533f5310 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.348855 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631a799-4051-4be6-9183-574b533f5310 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.361497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcb90a-6c70-4a5b-8bcd-e5cd4b7bf692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.362398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcb90a-6c70-4a5b-8bcd-e5cd4b7bf692 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.362853 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcb90a-6c70-4a5b-8bcd-e5cd4b7bf692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.363276 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcb90a-6c70-4a5b-8bcd-e5cd4b7bf692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.364126 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcb90a-6c70-4a5b-8bcd-e5cd4b7bf692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.365981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcb90a-6c70-4a5b-8bcd-e5cd4b7bf692 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.383778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1008/2016] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:47.390421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcb90a-6c70-4a5b-8bcd-e5cd4b7bf692 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.405445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcb90a-6c70-4a5b-8bcd-e5cd4b7bf692 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.419007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f964f481c64dd28c34504fb81240e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:47.419007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f964f481c64dd28c34504fb81240e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:47.419410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e780376-52f3-4c44-b3a3-cffcc75924f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.420655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780376-52f3-4c44-b3a3-cffcc75924f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.421007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780376-52f3-4c44-b3a3-cffcc75924f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.421291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e780376-52f3-4c44-b3a3-cffcc75924f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.422142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e780376-52f3-4c44-b3a3-cffcc75924f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.425536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e780376-52f3-4c44-b3a3-cffcc75924f9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.450591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1009/2017] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:47.453398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e780376-52f3-4c44-b3a3-cffcc75924f9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.456342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69227479-b999-41fc-b0f0-eb98eacddafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f964f481c64dd28c34504fb81240e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:47.459658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1e780376-52f3-4c44-b3a3-cffcc75924f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:47.479850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e780376-52f3-4c44-b3a3-cffcc75924f9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.481631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1009/2018] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:46 2022] DELETE /identity/v3/users/a2f964f481c64dd28c34504fb81240e1 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:47.490633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed87fb-19fa-43ef-88ea-5ad6100b8ffa None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.491595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed87fb-19fa-43ef-88ea-5ad6100b8ffa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.492078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed87fb-19fa-43ef-88ea-5ad6100b8ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.519342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-77ed87fb-19fa-43ef-88ea-5ad6100b8ffa None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:47.520980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-77ed87fb-19fa-43ef-88ea-5ad6100b8ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:47.612426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1010/2019] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:47.619968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9e71b-4472-44f3-9df5-546ed7c4b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.620658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e71b-4472-44f3-9df5-546ed7c4b68e admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.620942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e71b-4472-44f3-9df5-546ed7c4b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.621284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e71b-4472-44f3-9df5-546ed7c4b68e admin admin] PATH_INFO: `/v3/projects/6924dcd680554ab0aedbdb6bf7180ae2/users/f46b1f38c60146178eac9d9ad4e010ac/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.638158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9e71b-4472-44f3-9df5-546ed7c4b68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6924dcd680554ab0aedbdb6bf7180ae2, user_id=f46b1f38c60146178eac9d9ad4e010ac, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:47.641305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9e71b-4472-44f3-9df5-546ed7c4b68e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:47.650406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed87fb-19fa-43ef-88ea-5ad6100b8ffa None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:47.653027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-77ed87fb-19fa-43ef-88ea-5ad6100b8ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:47.754470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1010/2020] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:47 2022] PUT /identity/v3/projects/6924dcd680554ab0aedbdb6bf7180ae2/users/f46b1f38c60146178eac9d9ad4e010ac/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:47.756365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4377ce9-0f21-4fa8-b8cf-a8d709bc01ec None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.756659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4377ce9-0f21-4fa8-b8cf-a8d709bc01ec None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.756940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4377ce9-0f21-4fa8-b8cf-a8d709bc01ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.797028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed87fb-19fa-43ef-88ea-5ad6100b8ffa None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:47.832349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e4377ce9-0f21-4fa8-b8cf-a8d709bc01ec None None] MFA Rules not processed for user `f46b1f38c60146178eac9d9ad4e010ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:47.832349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e4377ce9-0f21-4fa8-b8cf-a8d709bc01ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:47.852558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:47.928136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06448c06-5cb8-47d7-b62a-f68ecf7d8eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:47.928767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06448c06-5cb8-47d7-b62a-f68ecf7d8eff service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:47.929049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06448c06-5cb8-47d7-b62a-f68ecf7d8eff service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:47.929327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06448c06-5cb8-47d7-b62a-f68ecf7d8eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:47.948004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1011/2021] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:47.957198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4377ce9-0f21-4fa8-b8cf-a8d709bc01ec None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:48.074146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06448c06-5cb8-47d7-b62a-f68ecf7d8eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.076582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06448c06-5cb8-47d7-b62a-f68ecf7d8eff service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.084789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4377ce9-0f21-4fa8-b8cf-a8d709bc01ec None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.102674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1011/2022] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:21:48.103563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd76a0-5c0b-4f7a-8750-fcabddff2c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.115838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd76a0-5c0b-4f7a-8750-fcabddff2c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.115838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd76a0-5c0b-4f7a-8750-fcabddff2c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.115838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd76a0-5c0b-4f7a-8750-fcabddff2c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.115838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd76a0-5c0b-4f7a-8750-fcabddff2c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.121608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd76a0-5c0b-4f7a-8750-fcabddff2c52 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.257804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1012/2023] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:47 2022] POST /identity/v3/projects => generated 367 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:48.262081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06448c06-5cb8-47d7-b62a-f68ecf7d8eff service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:48.278205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06448c06-5cb8-47d7-b62a-f68ecf7d8eff service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.282192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd76a0-5c0b-4f7a-8750-fcabddff2c52 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:48.284493 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1abd76a0-5c0b-4f7a-8750-fcabddff2c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:48.300414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:48.381093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd76a0-5c0b-4f7a-8750-fcabddff2c52 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.396654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.396654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.396654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.396654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] PATH_INFO: `/v3/users/2c6775e434ef4b3aa6f08bc64c846077` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.398991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6775e434ef4b3aa6f08bc64c846077)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.401631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfa342-8e24-40c5-a0c2-ea1ee1aa0a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.402430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfa342-8e24-40c5-a0c2-ea1ee1aa0a66 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.402865 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfa342-8e24-40c5-a0c2-ea1ee1aa0a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.403138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfa342-8e24-40c5-a0c2-ea1ee1aa0a66 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.403862 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfa342-8e24-40c5-a0c2-ea1ee1aa0a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.405191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.406106 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfa342-8e24-40c5-a0c2-ea1ee1aa0a66 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.481189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:48.522815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1012/2024] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:48 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:48.527033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfa342-8e24-40c5-a0c2-ea1ee1aa0a66 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:48.551975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfa342-8e24-40c5-a0c2-ea1ee1aa0a66 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.557986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a4d5a-7018-4688-9c4b-c98b6615c3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.558905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a4d5a-7018-4688-9c4b-c98b6615c3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.559386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a4d5a-7018-4688-9c4b-c98b6615c3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.559941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a4d5a-7018-4688-9c4b-c98b6615c3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.561411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a4d5a-7018-4688-9c4b-c98b6615c3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.563667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a4d5a-7018-4688-9c4b-c98b6615c3c2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.581629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1013/2025] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:21:48.582861 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a4d5a-7018-4688-9c4b-c98b6615c3c2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:48.603727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a4d5a-7018-4688-9c4b-c98b6615c3c2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:48.634712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f54a-5817-49ac-a685-1c72a4c259b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:48.635375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f54a-5817-49ac-a685-1c72a4c259b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.639269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f54a-5817-49ac-a685-1c72a4c259b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.640037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f54a-5817-49ac-a685-1c72a4c259b4 admin admin] PATH_INFO: `/v3/projects/440b935d8c70402a9c17ae0c02e4d340/users/9ab2b0bcd7f54990be8c3cc78847b11e/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.652283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6775e434ef4b3aa6f08bc64c846077'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:48.682190 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6775e434ef4b3aa6f08bc64c846077'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:48.691044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62f54a-5817-49ac-a685-1c72a4c259b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440b935d8c70402a9c17ae0c02e4d340, user_id=9ab2b0bcd7f54990be8c3cc78847b11e, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:48.699526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62f54a-5817-49ac-a685-1c72a4c259b4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:48.713261 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6775e434ef4b3aa6f08bc64c846077'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:48.714041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6775e434ef4b3aa6f08bc64c846077'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:48.714690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4aabafa2-ed9f-41d6-b48c-209e25f8b320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6775e434ef4b3aa6f08bc64c846077'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:48.808695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1014/2026] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:48 2022] PUT /identity/v3/projects/440b935d8c70402a9c17ae0c02e4d340/users/9ab2b0bcd7f54990be8c3cc78847b11e/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:48.810194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1013/2027] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:48 2022] DELETE /identity/v3/users/2c6775e434ef4b3aa6f08bc64c846077 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:48.814230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f54a-5817-49ac-a685-1c72a4c259b4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:48.816454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ebf3b-71da-4339-a796-78de2204fa1d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:48.823309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ebf3b-71da-4339-a796-78de2204fa1d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:48.823451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5b62f54a-5817-49ac-a685-1c72a4c259b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:48.823574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ebf3b-71da-4339-a796-78de2204fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:48.871061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f88ebf3b-71da-4339-a796-78de2204fa1d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:48.877871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f88ebf3b-71da-4339-a796-78de2204fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:48.997768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f54a-5817-49ac-a685-1c72a4c259b4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.052179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1014/2028] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:49.062159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ebf3b-71da-4339-a796-78de2204fa1d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.065370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f88ebf3b-71da-4339-a796-78de2204fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:49.148880 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140012d-d0e1-4185-8fab-45ef21cfdd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.149503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140012d-d0e1-4185-8fab-45ef21cfdd84 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.151194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140012d-d0e1-4185-8fab-45ef21cfdd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.151472 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140012d-d0e1-4185-8fab-45ef21cfdd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.152325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140012d-d0e1-4185-8fab-45ef21cfdd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.157864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140012d-d0e1-4185-8fab-45ef21cfdd84 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.177413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1015/2029] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:49.177413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140012d-d0e1-4185-8fab-45ef21cfdd84 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.199262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140012d-d0e1-4185-8fab-45ef21cfdd84 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.207356 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3400c-9927-45a9-b0a9-ed5fe54ba3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.208372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3400c-9927-45a9-b0a9-ed5fe54ba3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.208651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3400c-9927-45a9-b0a9-ed5fe54ba3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.209552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3400c-9927-45a9-b0a9-ed5fe54ba3e7 admin admin] PATH_INFO: `/v3/projects/440b935d8c70402a9c17ae0c02e4d340/users/9ab2b0bcd7f54990be8c3cc78847b11e/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.213730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3400c-9927-45a9-b0a9-ed5fe54ba3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440b935d8c70402a9c17ae0c02e4d340, user_id=9ab2b0bcd7f54990be8c3cc78847b11e, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.217591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3400c-9927-45a9-b0a9-ed5fe54ba3e7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.217969 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ebf3b-71da-4339-a796-78de2204fa1d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.222984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332e1c9-1ff7-4c9e-af80-aebce564ae15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.223614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332e1c9-1ff7-4c9e-af80-aebce564ae15 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.223982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332e1c9-1ff7-4c9e-af80-aebce564ae15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.224257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332e1c9-1ff7-4c9e-af80-aebce564ae15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.232558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1016/2030] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:49 2022] PUT /identity/v3/projects/440b935d8c70402a9c17ae0c02e4d340/users/9ab2b0bcd7f54990be8c3cc78847b11e/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:49.249569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1868c9-ce31-4fd5-b941-5dc12ee32b4a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.249569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1868c9-ce31-4fd5-b941-5dc12ee32b4a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.249569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1868c9-ce31-4fd5-b941-5dc12ee32b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.253252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332e1c9-1ff7-4c9e-af80-aebce564ae15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.253252 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332e1c9-1ff7-4c9e-af80-aebce564ae15 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.273313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1015/2031] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:49.293558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332e1c9-1ff7-4c9e-af80-aebce564ae15 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.295285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4332e1c9-1ff7-4c9e-af80-aebce564ae15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:49.297280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5d1868c9-ce31-4fd5-b941-5dc12ee32b4a None None] MFA Rules not processed for user `9ab2b0bcd7f54990be8c3cc78847b11e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:49.303102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5d1868c9-ce31-4fd5-b941-5dc12ee32b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:49.309381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332e1c9-1ff7-4c9e-af80-aebce564ae15 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.431041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.433162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.433448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.434401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] PATH_INFO: `/v3/projects/4ec0d0e376464083980b6781c82bb9cf` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.436264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec0d0e376464083980b6781c82bb9cf)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.441276 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.473854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1017/2032] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:49.493556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1868c9-ce31-4fd5-b941-5dc12ee32b4a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.493556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5d1868c9-ce31-4fd5-b941-5dc12ee32b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:49.630276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1868c9-ce31-4fd5-b941-5dc12ee32b4a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.667595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec0d0e376464083980b6781c82bb9cf', 'request_id': 'req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:49.678290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec0d0e376464083980b6781c82bb9cf', 'request_id': 'req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:49.724627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872dd1-e8ea-47aa-be4e-6bafd910c241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.725318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872dd1-e8ea-47aa-be4e-6bafd910c241 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.725650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872dd1-e8ea-47aa-be4e-6bafd910c241 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.725950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872dd1-e8ea-47aa-be4e-6bafd910c241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.772127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec0d0e376464083980b6781c82bb9cf', 'request_id': 'req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:49.784728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] The token cache is being invalidate because project 4ec0d0e376464083980b6781c82bb9cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:49.786033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:49.786033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:49.787736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1016/2033] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:49 2022] DELETE /identity/v3/projects/4ec0d0e376464083980b6781c82bb9cf => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:49.791497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:49.793388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:49.812105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a872dd1-e8ea-47aa-be4e-6bafd910c241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.813856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a872dd1-e8ea-47aa-be4e-6bafd910c241 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:49.827320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1018/2034] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:21:49.907141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2751ec-e7e7-45fd-8e38-10c54ea821e5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:49.913383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:49.915895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:49.916400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:49.916779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] PATH_INFO: `/v3/users/c6e43a9e9e47428fad2bfdb7bd6bfe07` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:49.918144 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e43a9e9e47428fad2bfdb7bd6bfe07)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:49.921748 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:50.127092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872dd1-e8ea-47aa-be4e-6bafd910c241 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.138435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872dd1-e8ea-47aa-be4e-6bafd910c241 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.144795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95900bd9-4890-48d4-b1b2-6379e96a54b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.168003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95900bd9-4890-48d4-b1b2-6379e96a54b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.168368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95900bd9-4890-48d4-b1b2-6379e96a54b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.168655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95900bd9-4890-48d4-b1b2-6379e96a54b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.177547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-95900bd9-4890-48d4-b1b2-6379e96a54b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:50.218308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e43a9e9e47428fad2bfdb7bd6bfe07'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:50.238070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e43a9e9e47428fad2bfdb7bd6bfe07'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:50.295771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e43a9e9e47428fad2bfdb7bd6bfe07'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:50.300903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e43a9e9e47428fad2bfdb7bd6bfe07'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:50.307157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e43a9e9e47428fad2bfdb7bd6bfe07'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:50.336551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95900bd9-4890-48d4-b1b2-6379e96a54b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:50.338034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95900bd9-4890-48d4-b1b2-6379e96a54b0 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:50.351724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1019/2035] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:50.480628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1017/2036] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:49 2022] DELETE /identity/v3/users/c6e43a9e9e47428fad2bfdb7bd6bfe07 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:50.761961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf06a9-78e6-4181-a87b-000e5eacfddb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.761961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf06a9-78e6-4181-a87b-000e5eacfddb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.761961 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf06a9-78e6-4181-a87b-000e5eacfddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.782895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cecf06a9-78e6-4181-a87b-000e5eacfddb None None] MFA Rules not processed for user `e1e3509323f34441a2b9d9b39dddaa61`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:50.784171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cecf06a9-78e6-4181-a87b-000e5eacfddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:50.853672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1020/2037] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:50.865653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.867265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:50.924733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf06a9-78e6-4181-a87b-000e5eacfddb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:50.926175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cecf06a9-78e6-4181-a87b-000e5eacfddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:50.952618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f299d5-2cec-4b83-9506-ef5899d07e01 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:50.958096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8855e3e7fc84cd9ba1afaef4cc308c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:50.958779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:50.959069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:50.959347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:50.961270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:51.081644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.083854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.085391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.118353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1018/2038] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:51.119506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.120282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf06a9-78e6-4181-a87b-000e5eacfddb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.126563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:51.128684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.129431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.129892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.130366 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] PATH_INFO: `/v3/projects/a1de7ca8c8f34c5eaa1591caeb61c8b8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.132790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1de7ca8c8f34c5eaa1591caeb61c8b8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.135873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.150794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152b93-2ac9-4de7-82ff-ef228f7080dd service glance] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.162089 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.164785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.167766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.167766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] PATH_INFO: `/v3/users/96621bb1277a46c09ec8357dff724766` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.168141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96621bb1277a46c09ec8357dff724766)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.171760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.321743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1de7ca8c8f34c5eaa1591caeb61c8b8', 'request_id': 'req-e086a17a-17c7-40fd-a3fc-a0b5653793ad'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.333423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1de7ca8c8f34c5eaa1591caeb61c8b8', 'request_id': 'req-e086a17a-17c7-40fd-a3fc-a0b5653793ad'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.343375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1de7ca8c8f34c5eaa1591caeb61c8b8', 'request_id': 'req-e086a17a-17c7-40fd-a3fc-a0b5653793ad'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.502040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] The token cache is being invalidate because project a1de7ca8c8f34c5eaa1591caeb61c8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:51.502040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.502040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.506190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1021/2039] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:50 2022] DELETE /identity/v3/projects/a1de7ca8c8f34c5eaa1591caeb61c8b8 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:21:51.507304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.509116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:51.525231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96621bb1277a46c09ec8357dff724766'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.560593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96621bb1277a46c09ec8357dff724766'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.607473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:51.623057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96621bb1277a46c09ec8357dff724766'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.629402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96621bb1277a46c09ec8357dff724766'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.630256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96621bb1277a46c09ec8357dff724766'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.685248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a17a-17c7-40fd-a3fc-a0b5653793ad admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.702645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.703340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.703617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.703933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] PATH_INFO: `/v3/users/97a358414fc84858a1d0d42e1cdf9a79` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.705353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a358414fc84858a1d0d42e1cdf9a79)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.707655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:51.777450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1019/2040] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:51 2022] DELETE /identity/v3/users/96621bb1277a46c09ec8357dff724766 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:51.777450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:51.778588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:51.925562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a358414fc84858a1d0d42e1cdf9a79'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.933865 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a358414fc84858a1d0d42e1cdf9a79'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:51.965531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f540b-0564-4c7d-8c37-7dcc5096e1d8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:51.972591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:51.973328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:51.973793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:51.974151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] PATH_INFO: `/v3/projects/2e063616a2b344a3a151e1564fcb682d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:51.975547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e063616a2b344a3a151e1564fcb682d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:51.978308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.018149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a358414fc84858a1d0d42e1cdf9a79'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:52.019273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a358414fc84858a1d0d42e1cdf9a79'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:52.054545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f403972-46ee-4f2a-958c-97a8d2eea618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a358414fc84858a1d0d42e1cdf9a79'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:52.077664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1022/2041] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:51 2022] DELETE /identity/v3/users/97a358414fc84858a1d0d42e1cdf9a79 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:52.077664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e627b67-6357-49bb-ba6c-9668ab10b76c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.077664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e627b67-6357-49bb-ba6c-9668ab10b76c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.077664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e627b67-6357-49bb-ba6c-9668ab10b76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.105751 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e063616a2b344a3a151e1564fcb682d', 'request_id': 'req-2a895ce0-8dbe-4a7c-8c02-a944d07db574'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:52.109311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4e627b67-6357-49bb-ba6c-9668ab10b76c None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:52.110725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4e627b67-6357-49bb-ba6c-9668ab10b76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:52.119071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e063616a2b344a3a151e1564fcb682d', 'request_id': 'req-2a895ce0-8dbe-4a7c-8c02-a944d07db574'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:52.257924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e063616a2b344a3a151e1564fcb682d', 'request_id': 'req-2a895ce0-8dbe-4a7c-8c02-a944d07db574'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:52.264927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1023/2042] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:21:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:52.270095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe12143-6a3d-4fe9-8beb-af0b2d84219e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.271546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] The token cache is being invalidate because project 2e063616a2b344a3a151e1564fcb682d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:52.272152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:52.273557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe12143-6a3d-4fe9-8beb-af0b2d84219e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.274411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe12143-6a3d-4fe9-8beb-af0b2d84219e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.289231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:52.297832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1020/2043] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:51 2022] DELETE /identity/v3/projects/2e063616a2b344a3a151e1564fcb682d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:52.299216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.301057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:52.305567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ebe12143-6a3d-4fe9-8beb-af0b2d84219e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:52.307055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ebe12143-6a3d-4fe9-8beb-af0b2d84219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:52.467713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1024/2044] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:52.472223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1e77e-1b9c-4a9f-8ad0-524aa51a8186 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.472510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1e77e-1b9c-4a9f-8ad0-524aa51a8186 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.472778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1e77e-1b9c-4a9f-8ad0-524aa51a8186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.480321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a895ce0-8dbe-4a7c-8c02-a944d07db574 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.499654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.500374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.500650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.500921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.507499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:52.530346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-44a1e77e-1b9c-4a9f-8ad0-524aa51a8186 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:52.532237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.533501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-44a1e77e-1b9c-4a9f-8ad0-524aa51a8186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:52.533885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.598742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1021/2045] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:21:52.598742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.598742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:52.599990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1025/2046] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:52.599990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea68193-a9f7-4472-ad37-728ec9acded6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.599990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea68193-a9f7-4472-ad37-728ec9acded6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.599990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea68193-a9f7-4472-ad37-728ec9acded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.631870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3ea68193-a9f7-4472-ad37-728ec9acded6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:52.636639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3ea68193-a9f7-4472-ad37-728ec9acded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:52.714867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1026/2047] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:21:52.714867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea68193-a9f7-4472-ad37-728ec9acded6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.719550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea68193-a9f7-4472-ad37-728ec9acded6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.732885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22301b-33b8-429e-a805-36b1033a5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.733550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22301b-33b8-429e-a805-36b1033a5992 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.734568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22301b-33b8-429e-a805-36b1033a5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.734568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22301b-33b8-429e-a805-36b1033a5992 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.734962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22301b-33b8-429e-a805-36b1033a5992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:52.735276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22301b-33b8-429e-a805-36b1033a5992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.739669 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22301b-33b8-429e-a805-36b1033a5992 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.741608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ef3a8-ff4f-4a94-9c91-0a54bdfed09a service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.750001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ff020-163e-443c-a416-4511ec2962d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.751026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ff020-163e-443c-a416-4511ec2962d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.755394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ff020-163e-443c-a416-4511ec2962d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.755894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ff020-163e-443c-a416-4511ec2962d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.767867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1027/2048] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:52.783790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22301b-33b8-429e-a805-36b1033a5992 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.788447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ff020-163e-443c-a416-4511ec2962d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.804041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ff020-163e-443c-a416-4511ec2962d6 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.826030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22301b-33b8-429e-a805-36b1033a5992 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.848977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c44af-b7ad-4dd5-b02d-f8b9aa1bbbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.850009 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c44af-b7ad-4dd5-b02d-f8b9aa1bbbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.850525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c44af-b7ad-4dd5-b02d-f8b9aa1bbbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.850999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c44af-b7ad-4dd5-b02d-f8b9aa1bbbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.852002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c44af-b7ad-4dd5-b02d-f8b9aa1bbbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.852479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1022/2049] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:52.853601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ff020-163e-443c-a416-4511ec2962d6 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:52.856593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8d1ff020-163e-443c-a416-4511ec2962d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:52.860837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c44af-b7ad-4dd5-b02d-f8b9aa1bbbe4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:52.879268 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ff020-163e-443c-a416-4511ec2962d6 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:52.892767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:52.893698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:52.894151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:52.894570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] PATH_INFO: `/v3/projects/e8ef216619ed4bc4b2bfd58f755906ee` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:52.895947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ef216619ed4bc4b2bfd58f755906ee)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:52.898219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.081096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1028/2050] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:52 2022] POST /identity/v3/projects => generated 373 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:53.082163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c44af-b7ad-4dd5-b02d-f8b9aa1bbbe4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.109248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ef216619ed4bc4b2bfd58f755906ee', 'request_id': 'req-30655d8d-debb-4830-922c-ed6e990704ad'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:53.123713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ef216619ed4bc4b2bfd58f755906ee', 'request_id': 'req-30655d8d-debb-4830-922c-ed6e990704ad'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:53.217612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c44af-b7ad-4dd5-b02d-f8b9aa1bbbe4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.226210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19545022-d5c7-41d4-8ad6-2e0f91ea5c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.227275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19545022-d5c7-41d4-8ad6-2e0f91ea5c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.227938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19545022-d5c7-41d4-8ad6-2e0f91ea5c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.228612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19545022-d5c7-41d4-8ad6-2e0f91ea5c43 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.229465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19545022-d5c7-41d4-8ad6-2e0f91ea5c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.233419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19545022-d5c7-41d4-8ad6-2e0f91ea5c43 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.234960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ef216619ed4bc4b2bfd58f755906ee', 'request_id': 'req-30655d8d-debb-4830-922c-ed6e990704ad'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:53.261523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] The token cache is being invalidate because project e8ef216619ed4bc4b2bfd58f755906ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:53.261807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:53.263714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:53.265111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1023/2051] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:52 2022] DELETE /identity/v3/projects/e8ef216619ed4bc4b2bfd58f755906ee => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:53.266085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.275629 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:53.351655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1029/2052] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:53 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:53.354215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078234b-5837-468a-a838-0ad7dd318f86 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.354215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078234b-5837-468a-a838-0ad7dd318f86 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.354215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078234b-5837-468a-a838-0ad7dd318f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.416904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30655d8d-debb-4830-922c-ed6e990704ad admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.420761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8078234b-5837-468a-a838-0ad7dd318f86 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:53.424946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.425852 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.426279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.427270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] PATH_INFO: `/v3/users/f83da62462fb4dc5aff180756de3d12f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.429178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83da62462fb4dc5aff180756de3d12f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.431614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:53.431925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8078234b-5837-468a-a838-0ad7dd318f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:53.465036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1030/2053] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:53.466962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078234b-5837-468a-a838-0ad7dd318f86 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:53.467982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8078234b-5837-468a-a838-0ad7dd318f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:53.479173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:53.505647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078234b-5837-468a-a838-0ad7dd318f86 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:53.511702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:53.513141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:53.513489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:53.513879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] PATH_INFO: `/v3/users/a6621f9ad4404e7fa83a1d197787ffb5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:53.520792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6621f9ad4404e7fa83a1d197787ffb5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:53.520792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.195152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6621f9ad4404e7fa83a1d197787ffb5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.196713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6621f9ad4404e7fa83a1d197787ffb5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.199628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83da62462fb4dc5aff180756de3d12f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.220192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83da62462fb4dc5aff180756de3d12f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.234240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83da62462fb4dc5aff180756de3d12f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.235347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83da62462fb4dc5aff180756de3d12f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.236187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60050d75-380a-4e13-91e7-8410f87ebaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83da62462fb4dc5aff180756de3d12f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.285031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6621f9ad4404e7fa83a1d197787ffb5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.289614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6621f9ad4404e7fa83a1d197787ffb5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.303711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6621f9ad4404e7fa83a1d197787ffb5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.319920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1031/2054] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:53 2022] DELETE /identity/v3/users/a6621f9ad4404e7fa83a1d197787ffb5 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:54.322926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.323476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:54.383871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1024/2055] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:53 2022] DELETE /identity/v3/users/f83da62462fb4dc5aff180756de3d12f => generated 0 bytes in 1118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:54.385095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015977e-9a94-41af-98b0-93386e30b0f3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.385384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015977e-9a94-41af-98b0-93386e30b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.385667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015977e-9a94-41af-98b0-93386e30b0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.422264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1015977e-9a94-41af-98b0-93386e30b0f3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:54.423565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975214fc-9326-419c-ae44-2a337ee75267 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.424997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1015977e-9a94-41af-98b0-93386e30b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:54.496251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28677460-cd83-4aef-8e52-4e4f0ef3056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.497082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28677460-cd83-4aef-8e52-4e4f0ef3056d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.498170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28677460-cd83-4aef-8e52-4e4f0ef3056d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.498595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28677460-cd83-4aef-8e52-4e4f0ef3056d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.499446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28677460-cd83-4aef-8e52-4e4f0ef3056d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.503812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28677460-cd83-4aef-8e52-4e4f0ef3056d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.505770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:54.519523 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1032/2056] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:54.520175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28677460-cd83-4aef-8e52-4e4f0ef3056d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.522245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-28677460-cd83-4aef-8e52-4e4f0ef3056d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:54.537240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28677460-cd83-4aef-8e52-4e4f0ef3056d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.546015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.546718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.546999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.547325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] PATH_INFO: `/v3/projects/433b9b3142de4914b519daa26b669b36` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.554543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=433b9b3142de4914b519daa26b669b36)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.560520 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.595771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1025/2057] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:54.597187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01feee-b047-4b0e-8dba-813559925885 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.597544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01feee-b047-4b0e-8dba-813559925885 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.597892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01feee-b047-4b0e-8dba-813559925885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.632084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2a01feee-b047-4b0e-8dba-813559925885 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:54.633535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2a01feee-b047-4b0e-8dba-813559925885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:54.646596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1026/2058] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:54.646596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01feee-b047-4b0e-8dba-813559925885 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.657738 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01feee-b047-4b0e-8dba-813559925885 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.665522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ef69e-7d2c-4c4a-9f3f-ffab173989f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.667216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ef69e-7d2c-4c4a-9f3f-ffab173989f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.667339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ef69e-7d2c-4c4a-9f3f-ffab173989f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.667642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ef69e-7d2c-4c4a-9f3f-ffab173989f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.668440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ef69e-7d2c-4c4a-9f3f-ffab173989f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.670791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ef69e-7d2c-4c4a-9f3f-ffab173989f4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.688613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1027/2059] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:54.689770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ef69e-7d2c-4c4a-9f3f-ffab173989f4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.704176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ef69e-7d2c-4c4a-9f3f-ffab173989f4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.730752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433b9b3142de4914b519daa26b669b36', 'request_id': 'req-5c1a3c2c-093c-4c62-9765-4898ab01dad6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.768458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433b9b3142de4914b519daa26b669b36', 'request_id': 'req-5c1a3c2c-093c-4c62-9765-4898ab01dad6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.780767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433b9b3142de4914b519daa26b669b36', 'request_id': 'req-5c1a3c2c-093c-4c62-9765-4898ab01dad6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.816025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.816025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.816025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.816025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.816622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:54.816622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.816622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.833669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1028/2060] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:54.833669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.833892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:54.914922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a307-41c2-4b94-bf63-3052b0033d0e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.922770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9611d-516c-473c-aa4d-db0353d3a69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.923410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9611d-516c-473c-aa4d-db0353d3a69a service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.923695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9611d-516c-473c-aa4d-db0353d3a69a service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.924148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9611d-516c-473c-aa4d-db0353d3a69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.926856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] The token cache is being invalidate because project 433b9b3142de4914b519daa26b669b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:54.927361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.928295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:54.931909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1033/2061] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:54 2022] DELETE /identity/v3/projects/433b9b3142de4914b519daa26b669b36 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:54.933145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.935439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:54.937104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9611d-516c-473c-aa4d-db0353d3a69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.938616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9611d-516c-473c-aa4d-db0353d3a69a service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.951071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1029/2062] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:54.952111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9611d-516c-473c-aa4d-db0353d3a69a service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:54.965482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9611d-516c-473c-aa4d-db0353d3a69a service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.972948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c928-7b9d-4360-b7b7-0359c3ca3d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.973179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c928-7b9d-4360-b7b7-0359c3ca3d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:54.973410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c928-7b9d-4360-b7b7-0359c3ca3d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:54.973693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c928-7b9d-4360-b7b7-0359c3ca3d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:54.974413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16c928-7b9d-4360-b7b7-0359c3ca3d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:54.976700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16c928-7b9d-4360-b7b7-0359c3ca3d7d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:54.980020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a3c2c-093c-4c62-9765-4898ab01dad6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:54.996528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1140-f52c-4a30-9ac8-065a4a5e7961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:54.998899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1140-f52c-4a30-9ac8-065a4a5e7961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.001155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1140-f52c-4a30-9ac8-065a4a5e7961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.002128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1140-f52c-4a30-9ac8-065a4a5e7961 admin admin] PATH_INFO: `/v3/projects/d90f8ebd61024dea93000263b29bd0f9/users/a3aa8fadbea6427782aee1f1d2634ee7/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.057944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a1140-f52c-4a30-9ac8-065a4a5e7961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90f8ebd61024dea93000263b29bd0f9, user_id=a3aa8fadbea6427782aee1f1d2634ee7, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.062866 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a1140-f52c-4a30-9ac8-065a4a5e7961 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.118503 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1030/2063] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:54 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:55.120705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c928-7b9d-4360-b7b7-0359c3ca3d7d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.125176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fb16c928-7b9d-4360-b7b7-0359c3ca3d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:55.217905 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c928-7b9d-4360-b7b7-0359c3ca3d7d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.227570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.228259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.228554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.228820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] PATH_INFO: `/v3/users/782b7f03f7aa4445b8d751087077106d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.230702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=782b7f03f7aa4445b8d751087077106d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.232967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.254019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1034/2064] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:54 2022] PUT /identity/v3/projects/d90f8ebd61024dea93000263b29bd0f9/users/a3aa8fadbea6427782aee1f1d2634ee7/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:55.254975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1140-f52c-4a30-9ac8-065a4a5e7961 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.257917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-162a1140-f52c-4a30-9ac8-065a4a5e7961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:55.405479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1140-f52c-4a30-9ac8-065a4a5e7961 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.423168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.423845 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.424124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.424401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] PATH_INFO: `/v3/projects/90a58afe4f5f4636b410cd0791a7968c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.426851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a58afe4f5f4636b410cd0791a7968c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.428837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.491396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782b7f03f7aa4445b8d751087077106d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.507605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782b7f03f7aa4445b8d751087077106d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.536543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782b7f03f7aa4445b8d751087077106d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.537322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782b7f03f7aa4445b8d751087077106d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.537986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782b7f03f7aa4445b8d751087077106d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.586756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a58afe4f5f4636b410cd0791a7968c', 'request_id': 'req-72e0250c-f666-453a-b10b-ac05a3101e67'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.594648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a58afe4f5f4636b410cd0791a7968c', 'request_id': 'req-72e0250c-f666-453a-b10b-ac05a3101e67'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.601329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a58afe4f5f4636b410cd0791a7968c', 'request_id': 'req-72e0250c-f666-453a-b10b-ac05a3101e67'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.647822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1031/2065] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:55 2022] DELETE /identity/v3/users/782b7f03f7aa4445b8d751087077106d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:55.647822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.649927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:55.735857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] The token cache is being invalidate because project 90a58afe4f5f4636b410cd0791a7968c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:55.736248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.738655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-72e0250c-f666-453a-b10b-ac05a3101e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:55.747604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1035/2066] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:55 2022] DELETE /identity/v3/projects/90a58afe4f5f4636b410cd0791a7968c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:55.756881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7019a-2e69-4842-adb7-ad831cf56172 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.757173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7019a-2e69-4842-adb7-ad831cf56172 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.757450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7019a-2e69-4842-adb7-ad831cf56172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.799568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:55.801431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-59d7019a-2e69-4842-adb7-ad831cf56172 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:55.804268 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-59d7019a-2e69-4842-adb7-ad831cf56172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:55.830745 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e7a56-1dca-4131-a8b9-8c5bb3ef0ea6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.847369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc485294-cdf4-4298-8deb-91865823efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:55.848146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc485294-cdf4-4298-8deb-91865823efcb admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.848529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc485294-cdf4-4298-8deb-91865823efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.849035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc485294-cdf4-4298-8deb-91865823efcb admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:55.851265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc485294-cdf4-4298-8deb-91865823efcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:55.855367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc485294-cdf4-4298-8deb-91865823efcb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:55.936528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1036/2067] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:55.937786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7019a-2e69-4842-adb7-ad831cf56172 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:55.939532 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-59d7019a-2e69-4842-adb7-ad831cf56172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:55.979902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1032/2068] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:55 2022] POST /identity/v3/users => generated 290 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:55.981987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3f57b-d9cf-43c2-863b-cc48e42e6998 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:55.982120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7019a-2e69-4842-adb7-ad831cf56172 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:55.982258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3f57b-d9cf-43c2-863b-cc48e42e6998 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:55.982258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3f57b-d9cf-43c2-863b-cc48e42e6998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.000709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.004293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.004609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.004841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] PATH_INFO: `/v3/projects/733da636abfd4cb5b7d5d51a5c3c0bc3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.010509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733da636abfd4cb5b7d5d51a5c3c0bc3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.014666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.028221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-aeb3f57b-d9cf-43c2-863b-cc48e42e6998 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:56.030770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aeb3f57b-d9cf-43c2-863b-cc48e42e6998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.059043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1033/2069] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:56.065115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3f57b-d9cf-43c2-863b-cc48e42e6998 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.069197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aeb3f57b-d9cf-43c2-863b-cc48e42e6998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.221175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3f57b-d9cf-43c2-863b-cc48e42e6998 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.226396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7269bb-7e33-47dd-8378-46b5c2dcc433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.227384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7269bb-7e33-47dd-8378-46b5c2dcc433 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.228557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7269bb-7e33-47dd-8378-46b5c2dcc433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.229057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7269bb-7e33-47dd-8378-46b5c2dcc433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.242228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7269bb-7e33-47dd-8378-46b5c2dcc433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.244404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7269bb-7e33-47dd-8378-46b5c2dcc433 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.258350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1034/2070] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:56.259584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7269bb-7e33-47dd-8378-46b5c2dcc433 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.261186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1e7269bb-7e33-47dd-8378-46b5c2dcc433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.288048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7269bb-7e33-47dd-8378-46b5c2dcc433 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.291729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733da636abfd4cb5b7d5d51a5c3c0bc3', 'request_id': 'req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.311936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733da636abfd4cb5b7d5d51a5c3c0bc3', 'request_id': 'req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.339848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733da636abfd4cb5b7d5d51a5c3c0bc3', 'request_id': 'req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.382662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1155a2b-66db-4872-a7e5-e3e51bca5654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.383369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1155a2b-66db-4872-a7e5-e3e51bca5654 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.383656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1155a2b-66db-4872-a7e5-e3e51bca5654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.385016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1155a2b-66db-4872-a7e5-e3e51bca5654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.385016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1155a2b-66db-4872-a7e5-e3e51bca5654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.386348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1155a2b-66db-4872-a7e5-e3e51bca5654 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.404798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1035/2071] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:56.404798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7857d9-bc0e-410b-812d-f77d98e8c00d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.404798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7857d9-bc0e-410b-812d-f77d98e8c00d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.404798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7857d9-bc0e-410b-812d-f77d98e8c00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.426771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ed7857d9-bc0e-410b-812d-f77d98e8c00d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:56.428552 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ed7857d9-bc0e-410b-812d-f77d98e8c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.437997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1036/2072] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:56.439154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7857d9-bc0e-410b-812d-f77d98e8c00d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.450442 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7857d9-bc0e-410b-812d-f77d98e8c00d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.461748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] The token cache is being invalidate because project 733da636abfd4cb5b7d5d51a5c3c0bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:56.462135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.463458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.466365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1037/2073] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:55 2022] DELETE /identity/v3/projects/733da636abfd4cb5b7d5d51a5c3c0bc3 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:56.469461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.470542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36f3a2-b25c-4782-b851-d52760aabcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.472050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f3a2-b25c-4782-b851-d52760aabcae admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.472050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f3a2-b25c-4782-b851-d52760aabcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.473440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36f3a2-b25c-4782-b851-d52760aabcae admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.474984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36f3a2-b25c-4782-b851-d52760aabcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.475971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.483573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36f3a2-b25c-4782-b851-d52760aabcae admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.503621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1037/2074] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:56.503621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13413b03-a4da-49de-968d-f5dd28b811e1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.503621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13413b03-a4da-49de-968d-f5dd28b811e1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.507951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a2e7e-5a54-4603-b22f-9c061ef92e30 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.508860 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13413b03-a4da-49de-968d-f5dd28b811e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.515358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.518863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.518863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.518863 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.522227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:56.522227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.523639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.547450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-13413b03-a4da-49de-968d-f5dd28b811e1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:56.547450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-13413b03-a4da-49de-968d-f5dd28b811e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.549369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1038/2075] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:56.554710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.559037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1038/2076] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:56.560298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13413b03-a4da-49de-968d-f5dd28b811e1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.560723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.561888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-13413b03-a4da-49de-968d-f5dd28b811e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.593118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccc1bd-ed8f-4947-978b-a7a72bb2fcaa admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.596778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13413b03-a4da-49de-968d-f5dd28b811e1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.610752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa650-6de3-4b5d-ab73-1d5b35b7cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.613368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa650-6de3-4b5d-ab73-1d5b35b7cdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.614728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa650-6de3-4b5d-ab73-1d5b35b7cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.615013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa650-6de3-4b5d-ab73-1d5b35b7cdc6 admin admin] PATH_INFO: `/v3/projects/84dd600cf4b5416393fa00530a079ca8/users/2a7072bd5bb74dd8bd0cc81ac2d1720f/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.617124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.621333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.621333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.621333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] PATH_INFO: `/v3/projects/4453f116db104cb09f9d832c03d1ef68` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.621333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4453f116db104cb09f9d832c03d1ef68)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.621874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.679505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fa650-6de3-4b5d-ab73-1d5b35b7cdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84dd600cf4b5416393fa00530a079ca8, user_id=2a7072bd5bb74dd8bd0cc81ac2d1720f, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.683192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fa650-6de3-4b5d-ab73-1d5b35b7cdc6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.794994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1039/2077] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:56 2022] PUT /identity/v3/projects/84dd600cf4b5416393fa00530a079ca8/users/2a7072bd5bb74dd8bd0cc81ac2d1720f/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:56.796911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa650-6de3-4b5d-ab73-1d5b35b7cdc6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:56.798062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4453f116db104cb09f9d832c03d1ef68', 'request_id': 'req-36722ffc-38f1-4300-8bdc-0abecfcfb53f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.811701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4453f116db104cb09f9d832c03d1ef68', 'request_id': 'req-36722ffc-38f1-4300-8bdc-0abecfcfb53f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.820010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4453f116db104cb09f9d832c03d1ef68', 'request_id': 'req-36722ffc-38f1-4300-8bdc-0abecfcfb53f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.927810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] The token cache is being invalidate because project 4453f116db104cb09f9d832c03d1ef68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:21:56.927810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.927810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-36722ffc-38f1-4300-8bdc-0abecfcfb53f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:56.929588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa650-6de3-4b5d-ab73-1d5b35b7cdc6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:56.932023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1039/2078] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:21:56 2022] DELETE /identity/v3/projects/4453f116db104cb09f9d832c03d1ef68 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:56.933551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912c0dd-e8a8-4294-b8b3-21c37962a479 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.934437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912c0dd-e8a8-4294-b8b3-21c37962a479 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.934437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912c0dd-e8a8-4294-b8b3-21c37962a479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.944492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6a46c-8efa-400f-a85a-682e5833a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:56.952310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6a46c-8efa-400f-a85a-682e5833a442 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.952310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6a46c-8efa-400f-a85a-682e5833a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.952310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6a46c-8efa-400f-a85a-682e5833a442 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:56.952310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6a46c-8efa-400f-a85a-682e5833a442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:56.953683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6a46c-8efa-400f-a85a-682e5833a442 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:56.958571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5912c0dd-e8a8-4294-b8b3-21c37962a479 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:56.960031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5912c0dd-e8a8-4294-b8b3-21c37962a479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:56.969295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1040/2079] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:56.970716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b523d44-f556-49cf-ba0d-4cf809cb6bc4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:56.971084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b523d44-f556-49cf-ba0d-4cf809cb6bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:56.971451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b523d44-f556-49cf-ba0d-4cf809cb6bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.008312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5b523d44-f556-49cf-ba0d-4cf809cb6bc4 None None] MFA Rules not processed for user `2a7072bd5bb74dd8bd0cc81ac2d1720f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:57.009558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5b523d44-f556-49cf-ba0d-4cf809cb6bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:57.080565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1041/2080] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:57.081882 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8bde-9bd3-413d-8c6c-1903d66d8fcb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.082193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8bde-9bd3-413d-8c6c-1903d66d8fcb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.082489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8bde-9bd3-413d-8c6c-1903d66d8fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.102742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d40c8bde-9bd3-413d-8c6c-1903d66d8fcb None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:57.104294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d40c8bde-9bd3-413d-8c6c-1903d66d8fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:57.120522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1042/2081] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:57.120522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8bde-9bd3-413d-8c6c-1903d66d8fcb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.125509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8bde-9bd3-413d-8c6c-1903d66d8fcb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.130197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:57.130783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.131061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.131334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.132010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:57.132310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:57.133895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:57.148498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1043/2082] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:57.149463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.151507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:57.164399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7050ce6-d3d3-4146-8870-897122cc6193 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.169295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e03e64-6193-4e53-bddb-e22a1a85fc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:57.169947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e03e64-6193-4e53-bddb-e22a1a85fc8c admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.170225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e03e64-6193-4e53-bddb-e22a1a85fc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.170499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e03e64-6193-4e53-bddb-e22a1a85fc8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.171154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e03e64-6193-4e53-bddb-e22a1a85fc8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:57.173158 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e03e64-6193-4e53-bddb-e22a1a85fc8c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:57.545709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1040/2083] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:56 2022] POST /identity/v3/projects => generated 391 bytes in 750 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:57.547257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046ff5-1c44-4a4f-8483-760692e2e09e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.547643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046ff5-1c44-4a4f-8483-760692e2e09e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.548057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046ff5-1c44-4a4f-8483-760692e2e09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.568807 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b5046ff5-1c44-4a4f-8483-760692e2e09e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:57.570124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b5046ff5-1c44-4a4f-8483-760692e2e09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:57.583681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1044/2084] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:57 2022] POST /identity/v3/projects => generated 379 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:57.584886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e03e64-6193-4e53-bddb-e22a1a85fc8c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.641033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1041/2085] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:57.641881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5046ff5-1c44-4a4f-8483-760692e2e09e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.644821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b5046ff5-1c44-4a4f-8483-760692e2e09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:57.655199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e03e64-6193-4e53-bddb-e22a1a85fc8c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.662427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5046ff5-1c44-4a4f-8483-760692e2e09e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.664154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39a9b2-fa90-43a8-a7c2-d844964bca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:57.665052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39a9b2-fa90-43a8-a7c2-d844964bca99 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.665247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39a9b2-fa90-43a8-a7c2-d844964bca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.665524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625ddb-4d27-4290-96de-5f28f687d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:57.665712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39a9b2-fa90-43a8-a7c2-d844964bca99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.666785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625ddb-4d27-4290-96de-5f28f687d5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.667058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39a9b2-fa90-43a8-a7c2-d844964bca99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:57.667428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625ddb-4d27-4290-96de-5f28f687d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.669461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625ddb-4d27-4290-96de-5f28f687d5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.671440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39a9b2-fa90-43a8-a7c2-d844964bca99 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:57.671693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82625ddb-4d27-4290-96de-5f28f687d5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:57.675115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82625ddb-4d27-4290-96de-5f28f687d5f0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:57.833186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1045/2086] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:57 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:57.833812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1042/2087] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:57 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:57.834423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39a9b2-fa90-43a8-a7c2-d844964bca99 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.835576 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625ddb-4d27-4290-96de-5f28f687d5f0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:57.862314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625ddb-4d27-4290-96de-5f28f687d5f0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.886223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:57.957215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39a9b2-fa90-43a8-a7c2-d844964bca99 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:57.970838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffbf44-f986-4e24-b08f-24ab636d0ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:57.972227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbf44-f986-4e24-b08f-24ab636d0ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:57.972227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbf44-f986-4e24-b08f-24ab636d0ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:57.972574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbf44-f986-4e24-b08f-24ab636d0ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:57.973072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffbf44-f986-4e24-b08f-24ab636d0ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:57.977210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffbf44-f986-4e24-b08f-24ab636d0ae1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:57.999897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95008637-484c-4073-9bf5-0f96e1c006cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.001637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95008637-484c-4073-9bf5-0f96e1c006cc admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.006814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95008637-484c-4073-9bf5-0f96e1c006cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.007346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95008637-484c-4073-9bf5-0f96e1c006cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.009398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95008637-484c-4073-9bf5-0f96e1c006cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:21:58.011123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95008637-484c-4073-9bf5-0f96e1c006cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.015017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95008637-484c-4073-9bf5-0f96e1c006cc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.054495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1043/2088] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:21:58.055986 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95008637-484c-4073-9bf5-0f96e1c006cc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.070441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95008637-484c-4073-9bf5-0f96e1c006cc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.075452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beb239-faf1-418f-9c80-6ddca94a1077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.076642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beb239-faf1-418f-9c80-6ddca94a1077 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.077171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beb239-faf1-418f-9c80-6ddca94a1077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.077171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beb239-faf1-418f-9c80-6ddca94a1077 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.077909 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beb239-faf1-418f-9c80-6ddca94a1077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.080308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beb239-faf1-418f-9c80-6ddca94a1077 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.152238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1046/2089] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:57 2022] POST /identity/v3/users => generated 296 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:58.156070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffbf44-f986-4e24-b08f-24ab636d0ae1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.171590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffbf44-f986-4e24-b08f-24ab636d0ae1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.176774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19806f1-d996-48fa-a877-ce6a57461e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.177579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19806f1-d996-48fa-a877-ce6a57461e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.177923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19806f1-d996-48fa-a877-ce6a57461e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.178257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19806f1-d996-48fa-a877-ce6a57461e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.178990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19806f1-d996-48fa-a877-ce6a57461e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.181461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19806f1-d996-48fa-a877-ce6a57461e83 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.186377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1044/2090] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:58 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:58.187468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beb239-faf1-418f-9c80-6ddca94a1077 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.204575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1047/2091] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:58.204575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19806f1-d996-48fa-a877-ce6a57461e83 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.206542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e19806f1-d996-48fa-a877-ce6a57461e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:58.212444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beb239-faf1-418f-9c80-6ddca94a1077 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.220944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfee0e-c7f1-4abe-97f5-f01ab01fc191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.221568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfee0e-c7f1-4abe-97f5-f01ab01fc191 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.221847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfee0e-c7f1-4abe-97f5-f01ab01fc191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.222121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfee0e-c7f1-4abe-97f5-f01ab01fc191 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.222769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfee0e-c7f1-4abe-97f5-f01ab01fc191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.224751 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfee0e-c7f1-4abe-97f5-f01ab01fc191 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.229462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19806f1-d996-48fa-a877-ce6a57461e83 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.235543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.241577 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.241577 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.241577 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] PATH_INFO: `/v3/users/f46b1f38c60146178eac9d9ad4e010ac` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.241577 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46b1f38c60146178eac9d9ad4e010ac)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.243144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.354950 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1045/2092] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:58 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:58.356256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfee0e-c7f1-4abe-97f5-f01ab01fc191 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.436159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfee0e-c7f1-4abe-97f5-f01ab01fc191 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.442324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad95285-c1ee-45b8-a47a-579fee4c34c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.446101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad95285-c1ee-45b8-a47a-579fee4c34c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.446101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad95285-c1ee-45b8-a47a-579fee4c34c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.446101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad95285-c1ee-45b8-a47a-579fee4c34c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.446101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad95285-c1ee-45b8-a47a-579fee4c34c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.446101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad95285-c1ee-45b8-a47a-579fee4c34c6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.457154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1046/2093] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:58.457989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad95285-c1ee-45b8-a47a-579fee4c34c6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.473689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad95285-c1ee-45b8-a47a-579fee4c34c6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.478784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4260fe-e441-4f00-9e10-37c8ae9a8941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.479450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4260fe-e441-4f00-9e10-37c8ae9a8941 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.479733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4260fe-e441-4f00-9e10-37c8ae9a8941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.480039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4260fe-e441-4f00-9e10-37c8ae9a8941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.480681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4260fe-e441-4f00-9e10-37c8ae9a8941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.483347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4260fe-e441-4f00-9e10-37c8ae9a8941 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.493131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46b1f38c60146178eac9d9ad4e010ac'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:58.493824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1047/2094] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:58.494667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4260fe-e441-4f00-9e10-37c8ae9a8941 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.497299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46b1f38c60146178eac9d9ad4e010ac'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:58.506232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4260fe-e441-4f00-9e10-37c8ae9a8941 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.511587 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12213ebe-ce82-468f-aff5-72f7f765f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.512383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12213ebe-ce82-468f-aff5-72f7f765f6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.512778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12213ebe-ce82-468f-aff5-72f7f765f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.513155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12213ebe-ce82-468f-aff5-72f7f765f6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.514477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12213ebe-ce82-468f-aff5-72f7f765f6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.516233 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12213ebe-ce82-468f-aff5-72f7f765f6b2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.528905 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1048/2095] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:58.529870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12213ebe-ce82-468f-aff5-72f7f765f6b2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.541085 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12213ebe-ce82-468f-aff5-72f7f765f6b2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.545944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64d57-3fa8-4df9-b8cc-c8e49dfdb623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.546600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64d57-3fa8-4df9-b8cc-c8e49dfdb623 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.546838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64d57-3fa8-4df9-b8cc-c8e49dfdb623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.547111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64d57-3fa8-4df9-b8cc-c8e49dfdb623 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.547731 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64d57-3fa8-4df9-b8cc-c8e49dfdb623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.549671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64d57-3fa8-4df9-b8cc-c8e49dfdb623 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.633872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46b1f38c60146178eac9d9ad4e010ac'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:58.634872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46b1f38c60146178eac9d9ad4e010ac'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:58.655655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46b1f38c60146178eac9d9ad4e010ac'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:21:58.673778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1048/2096] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:21:58 2022] DELETE /identity/v3/users/f46b1f38c60146178eac9d9ad4e010ac => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:58.674603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.677627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:58.689722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1049/2097] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:58 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:58.691285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64d57-3fa8-4df9-b8cc-c8e49dfdb623 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.693577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-58c64d57-3fa8-4df9-b8cc-c8e49dfdb623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:58.709959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64d57-3fa8-4df9-b8cc-c8e49dfdb623 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.817612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef198bb-ab56-4827-afdc-e9e4fcee14ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.818505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef198bb-ab56-4827-afdc-e9e4fcee14ff admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.819015 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef198bb-ab56-4827-afdc-e9e4fcee14ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.819440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef198bb-ab56-4827-afdc-e9e4fcee14ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.820564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef198bb-ab56-4827-afdc-e9e4fcee14ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.822424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef198bb-ab56-4827-afdc-e9e4fcee14ff admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.824184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e2ed2-9362-4988-9833-190c3bbbb1ff admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.831409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625849a4-12e6-4073-a79a-4cded341d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.833998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625849a4-12e6-4073-a79a-4cded341d378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.834384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625849a4-12e6-4073-a79a-4cded341d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.834760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625849a4-12e6-4073-a79a-4cded341d378 admin admin] PATH_INFO: `/v3/projects/8793d09e72fc45f28f24b6e568b0a5b7/users/6c0c1a60495048f18e49034a6568b065/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.835620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1050/2098] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:58.836621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef198bb-ab56-4827-afdc-e9e4fcee14ff admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:58.838778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1ef198bb-ab56-4827-afdc-e9e4fcee14ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:58.859379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef198bb-ab56-4827-afdc-e9e4fcee14ff admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:58.859932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625849a4-12e6-4073-a79a-4cded341d378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8793d09e72fc45f28f24b6e568b0a5b7, user_id=6c0c1a60495048f18e49034a6568b065, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.862924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625849a4-12e6-4073-a79a-4cded341d378 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:58.866820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d105b-ed7a-4fcb-8307-bed2854a0e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:58.867827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d105b-ed7a-4fcb-8307-bed2854a0e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:58.868279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d105b-ed7a-4fcb-8307-bed2854a0e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:58.868709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d105b-ed7a-4fcb-8307-bed2854a0e26 admin admin] PATH_INFO: `/v3/projects/d259012fcc3249f1a7a1f596d72d8156/users/ef569b9142a14d4e924af8692e75065a/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:58.887042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d105b-ed7a-4fcb-8307-bed2854a0e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d259012fcc3249f1a7a1f596d72d8156, user_id=ef569b9142a14d4e924af8692e75065a, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:58.890377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d105b-ed7a-4fcb-8307-bed2854a0e26 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.030234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1049/2099] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:58 2022] PUT /identity/v3/projects/8793d09e72fc45f28f24b6e568b0a5b7/users/6c0c1a60495048f18e49034a6568b065/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:59.033212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43c806-b1bd-4cb0-b4d5-b7e7099f6b8a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.033212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43c806-b1bd-4cb0-b4d5-b7e7099f6b8a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.033212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43c806-b1bd-4cb0-b4d5-b7e7099f6b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.056856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bb43c806-b1bd-4cb0-b4d5-b7e7099f6b8a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:59.058226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bb43c806-b1bd-4cb0-b4d5-b7e7099f6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.119098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1051/2100] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:58 2022] PUT /identity/v3/projects/d259012fcc3249f1a7a1f596d72d8156/users/ef569b9142a14d4e924af8692e75065a/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:59.119098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d105b-ed7a-4fcb-8307-bed2854a0e26 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.119371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9a9d105b-ed7a-4fcb-8307-bed2854a0e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.144783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1050/2101] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:59.146192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d32af-e9e7-438f-8c0a-65a0b4deca9c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.146605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d32af-e9e7-438f-8c0a-65a0b4deca9c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.146970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d32af-e9e7-438f-8c0a-65a0b4deca9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.187486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ba5d32af-e9e7-438f-8c0a-65a0b4deca9c None None] MFA Rules not processed for user `a3aa8fadbea6427782aee1f1d2634ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:59.189428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ba5d32af-e9e7-438f-8c0a-65a0b4deca9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.217499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d105b-ed7a-4fcb-8307-bed2854a0e26 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.225246 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbc259-8936-4201-b4b1-c18986441c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.225864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbc259-8936-4201-b4b1-c18986441c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.226142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbc259-8936-4201-b4b1-c18986441c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.226413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbc259-8936-4201-b4b1-c18986441c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.227067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbc259-8936-4201-b4b1-c18986441c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.228941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbc259-8936-4201-b4b1-c18986441c07 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.250541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1052/2102] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:59.251631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbc259-8936-4201-b4b1-c18986441c07 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.266037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbc259-8936-4201-b4b1-c18986441c07 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.273692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77379d-1d90-4610-9e66-ba1d26981015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.274901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77379d-1d90-4610-9e66-ba1d26981015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.275325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77379d-1d90-4610-9e66-ba1d26981015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.275773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77379d-1d90-4610-9e66-ba1d26981015 admin admin] PATH_INFO: `/v3/projects/cd5007cbd4704bcf8238b0379b286710/users/422f027c14884f5384f2ed2ff68c82f8/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.298468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1051/2103] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:59.299516 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d32af-e9e7-438f-8c0a-65a0b4deca9c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.300821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77379d-1d90-4610-9e66-ba1d26981015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5007cbd4704bcf8238b0379b286710, user_id=422f027c14884f5384f2ed2ff68c82f8, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.303971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77379d-1d90-4610-9e66-ba1d26981015 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.311977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d32af-e9e7-438f-8c0a-65a0b4deca9c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.315150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:21:59.318930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d20569-92e1-4638-be9e-0375aa8904a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.325931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20569-92e1-4638-be9e-0375aa8904a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.325931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20569-92e1-4638-be9e-0375aa8904a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.325931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20569-92e1-4638-be9e-0375aa8904a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.325931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d20569-92e1-4638-be9e-0375aa8904a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.325931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d20569-92e1-4638-be9e-0375aa8904a1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.334673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1052/2104] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:59.335698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468c6dd-61f3-486a-b402-faa587814b17 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.335698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468c6dd-61f3-486a-b402-faa587814b17 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.336232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468c6dd-61f3-486a-b402-faa587814b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.355659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4468c6dd-61f3-486a-b402-faa587814b17 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:59.360347 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4468c6dd-61f3-486a-b402-faa587814b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.364998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1053/2105] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:59.365843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468c6dd-61f3-486a-b402-faa587814b17 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.367163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4468c6dd-61f3-486a-b402-faa587814b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.402879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1053/2106] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:59 2022] PUT /identity/v3/projects/cd5007cbd4704bcf8238b0379b286710/users/422f027c14884f5384f2ed2ff68c82f8/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:59.404733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77379d-1d90-4610-9e66-ba1d26981015 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.450300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468c6dd-61f3-486a-b402-faa587814b17 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.481182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77379d-1d90-4610-9e66-ba1d26981015 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.487229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8606f5-1e73-4794-bb10-a1605aeebbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.488231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8606f5-1e73-4794-bb10-a1605aeebbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.488231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8606f5-1e73-4794-bb10-a1605aeebbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.488462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8606f5-1e73-4794-bb10-a1605aeebbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.489170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8606f5-1e73-4794-bb10-a1605aeebbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.491190 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8606f5-1e73-4794-bb10-a1605aeebbf3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.505291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1054/2107] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:21:59.505291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8606f5-1e73-4794-bb10-a1605aeebbf3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.505575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8e8606f5-1e73-4794-bb10-a1605aeebbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.511765 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054abad1-3240-4a6c-bc8c-0fa1d2d296dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.512719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054abad1-3240-4a6c-bc8c-0fa1d2d296dc service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.512719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054abad1-3240-4a6c-bc8c-0fa1d2d296dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.512719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054abad1-3240-4a6c-bc8c-0fa1d2d296dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.521970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8606f5-1e73-4794-bb10-a1605aeebbf3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.523573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054abad1-3240-4a6c-bc8c-0fa1d2d296dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.525660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054abad1-3240-4a6c-bc8c-0fa1d2d296dc service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.528094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bc867-afa8-49f4-9ba4-26935567fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.528755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc867-afa8-49f4-9ba4-26935567fdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.529686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc867-afa8-49f4-9ba4-26935567fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.530106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bc867-afa8-49f4-9ba4-26935567fdb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.531067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bc867-afa8-49f4-9ba4-26935567fdb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.534428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bc867-afa8-49f4-9ba4-26935567fdb6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.537417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1054/2108] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:59.538020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054abad1-3240-4a6c-bc8c-0fa1d2d296dc service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.551760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054abad1-3240-4a6c-bc8c-0fa1d2d296dc service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.559608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628343d4-1189-408b-b044-f471d7d1004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.560993 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628343d4-1189-408b-b044-f471d7d1004f admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.561396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628343d4-1189-408b-b044-f471d7d1004f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.561688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628343d4-1189-408b-b044-f471d7d1004f admin admin] PATH_INFO: `/v3/projects/8793d09e72fc45f28f24b6e568b0a5b7/users/6c0c1a60495048f18e49034a6568b065/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.564513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628343d4-1189-408b-b044-f471d7d1004f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8793d09e72fc45f28f24b6e568b0a5b7, user_id=6c0c1a60495048f18e49034a6568b065, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.567369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628343d4-1189-408b-b044-f471d7d1004f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.580370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1055/2109] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:59 2022] PUT /identity/v3/projects/8793d09e72fc45f28f24b6e568b0a5b7/users/6c0c1a60495048f18e49034a6568b065/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:59.581006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628343d4-1189-408b-b044-f471d7d1004f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.648462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1055/2110] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:21:59 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:21:59.648462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78808b-1f05-4f53-b9af-f6c96e54462d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.648462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78808b-1f05-4f53-b9af-f6c96e54462d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.648462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78808b-1f05-4f53-b9af-f6c96e54462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.651284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628343d4-1189-408b-b044-f471d7d1004f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.678943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-fc78808b-1f05-4f53-b9af-f6c96e54462d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:59.680648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fc78808b-1f05-4f53-b9af-f6c96e54462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.731670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95f1df-5822-4e28-b9d4-ed266c02dbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.732976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95f1df-5822-4e28-b9d4-ed266c02dbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.733243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95f1df-5822-4e28-b9d4-ed266c02dbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.733700 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95f1df-5822-4e28-b9d4-ed266c02dbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.781574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1056/2111] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:21:59.788788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78808b-1f05-4f53-b9af-f6c96e54462d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:21:59.810973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78808b-1f05-4f53-b9af-f6c96e54462d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:21:59.816664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ad4f-66ac-4017-b510-17a502729572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:21:59.817912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ad4f-66ac-4017-b510-17a502729572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.818399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ad4f-66ac-4017-b510-17a502729572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.818816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ad4f-66ac-4017-b510-17a502729572 admin admin] PATH_INFO: `/v3/projects/94f5bede59024f89b54f6b63c76da92e/users/440f055de76c4b60bf8e6669f3c85c1b/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.837546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650ad4f-66ac-4017-b510-17a502729572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f5bede59024f89b54f6b63c76da92e, user_id=440f055de76c4b60bf8e6669f3c85c1b, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.840757 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650ad4f-66ac-4017-b510-17a502729572 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.845701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95f1df-5822-4e28-b9d4-ed266c02dbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:21:59.847210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95f1df-5822-4e28-b9d4-ed266c02dbc0 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:21:59.870675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1056/2112] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:21:59.872423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722130f-9fc8-4f48-ae33-52454747433b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:21:59.876466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722130f-9fc8-4f48-ae33-52454747433b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:21:59.876747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722130f-9fc8-4f48-ae33-52454747433b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:21:59.916277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4722130f-9fc8-4f48-ae33-52454747433b None None] MFA Rules not processed for user `6c0c1a60495048f18e49034a6568b065`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:21:59.918755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4722130f-9fc8-4f48-ae33-52454747433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:21:59.925304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1057/2113] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:21:59 2022] PUT /identity/v3/projects/94f5bede59024f89b54f6b63c76da92e/users/440f055de76c4b60bf8e6669f3c85c1b/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:21:59.928348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ad4f-66ac-4017-b510-17a502729572 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.040697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ad4f-66ac-4017-b510-17a502729572 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.048426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5ccd-33f5-4118-9ffb-8221aedf559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.049225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5ccd-33f5-4118-9ffb-8221aedf559b admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.049653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5ccd-33f5-4118-9ffb-8221aedf559b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.050302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5ccd-33f5-4118-9ffb-8221aedf559b admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.051147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d5ccd-33f5-4118-9ffb-8221aedf559b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.053443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d5ccd-33f5-4118-9ffb-8221aedf559b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.086926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1057/2114] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:00.086926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722130f-9fc8-4f48-ae33-52454747433b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.089402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4722130f-9fc8-4f48-ae33-52454747433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:00.171075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722130f-9fc8-4f48-ae33-52454747433b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.175274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306db90-747a-4967-a32f-26a9bb44a605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.175984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306db90-747a-4967-a32f-26a9bb44a605 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.176811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306db90-747a-4967-a32f-26a9bb44a605 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.176811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306db90-747a-4967-a32f-26a9bb44a605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.186485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1058/2115] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:21:59 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:00.189854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306db90-747a-4967-a32f-26a9bb44a605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.191760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dae26-b144-4aa0-80d6-a633210f4235 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.191760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dae26-b144-4aa0-80d6-a633210f4235 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.191978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306db90-747a-4967-a32f-26a9bb44a605 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.192180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dae26-b144-4aa0-80d6-a633210f4235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.204939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1058/2116] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:00.205938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306db90-747a-4967-a32f-26a9bb44a605 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.207319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2306db90-747a-4967-a32f-26a9bb44a605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:00.225035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306db90-747a-4967-a32f-26a9bb44a605 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.233792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.233999 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a36dae26-b144-4aa0-80d6-a633210f4235 None None] MFA Rules not processed for user `440f055de76c4b60bf8e6669f3c85c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:00.234603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.234948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.235286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] PATH_INFO: `/v3/projects/6924dcd680554ab0aedbdb6bf7180ae2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.235507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a36dae26-b144-4aa0-80d6-a633210f4235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:00.236600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6924dcd680554ab0aedbdb6bf7180ae2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.238728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.318846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1059/2117] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:00.320105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dae26-b144-4aa0-80d6-a633210f4235 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.321417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a36dae26-b144-4aa0-80d6-a633210f4235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:00.423875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dae26-b144-4aa0-80d6-a633210f4235 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.436476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6924dcd680554ab0aedbdb6bf7180ae2', 'request_id': 'req-b3af3ed8-50ab-47ef-9812-2d85cec60045'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:00.449957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6924dcd680554ab0aedbdb6bf7180ae2', 'request_id': 'req-b3af3ed8-50ab-47ef-9812-2d85cec60045'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:00.460324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6924dcd680554ab0aedbdb6bf7180ae2', 'request_id': 'req-b3af3ed8-50ab-47ef-9812-2d85cec60045'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:00.496076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97ca8-68a7-48df-b0c0-abe496eea151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.496970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97ca8-68a7-48df-b0c0-abe496eea151 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.497350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97ca8-68a7-48df-b0c0-abe496eea151 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.498376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97ca8-68a7-48df-b0c0-abe496eea151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.568548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb97ca8-68a7-48df-b0c0-abe496eea151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.569609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb97ca8-68a7-48df-b0c0-abe496eea151 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.596782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1060/2118] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:00.598872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97ca8-68a7-48df-b0c0-abe496eea151 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.611539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] The token cache is being invalidate because project 6924dcd680554ab0aedbdb6bf7180ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:00.617137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:00.617137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:00.617137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1059/2119] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:00 2022] DELETE /identity/v3/projects/6924dcd680554ab0aedbdb6bf7180ae2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:00.617137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.624229 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:00.767455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97ca8-68a7-48df-b0c0-abe496eea151 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.782786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa369-e0dd-4b08-8fc9-3bed7ec4d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.784121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa369-e0dd-4b08-8fc9-3bed7ec4d16b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.784418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa369-e0dd-4b08-8fc9-3bed7ec4d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.785846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa369-e0dd-4b08-8fc9-3bed7ec4d16b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.787231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fa369-e0dd-4b08-8fc9-3bed7ec4d16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.789716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fa369-e0dd-4b08-8fc9-3bed7ec4d16b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.817222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af3ed8-50ab-47ef-9812-2d85cec60045 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.817822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1061/2120] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:00.825095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa369-e0dd-4b08-8fc9-3bed7ec4d16b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.826280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c42ee0-f02f-4f24-baf5-24db448d7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.827245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42ee0-f02f-4f24-baf5-24db448d7cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.827670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42ee0-f02f-4f24-baf5-24db448d7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.828143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42ee0-f02f-4f24-baf5-24db448d7cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.828983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c42ee0-f02f-4f24-baf5-24db448d7cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.831808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c42ee0-f02f-4f24-baf5-24db448d7cd8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.833020 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c10fa369-e0dd-4b08-8fc9-3bed7ec4d16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:00.861981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa369-e0dd-4b08-8fc9-3bed7ec4d16b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:00.874212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:00.875333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:00.875941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:00.876401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] PATH_INFO: `/v3/users/9ab2b0bcd7f54990be8c3cc78847b11e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:00.878896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab2b0bcd7f54990be8c3cc78847b11e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:00.882230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:00.890995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:00.979991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1060/2121] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:00 2022] POST /identity/v3/projects => generated 373 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:00.981627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c42ee0-f02f-4f24-baf5-24db448d7cd8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:00.987335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-97c42ee0-f02f-4f24-baf5-24db448d7cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:01.203707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c42ee0-f02f-4f24-baf5-24db448d7cd8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:01.227485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c3ba3-6559-499b-8f25-43caf64b24c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:01.228343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c3ba3-6559-499b-8f25-43caf64b24c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:01.228809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c3ba3-6559-499b-8f25-43caf64b24c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:01.229189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c3ba3-6559-499b-8f25-43caf64b24c3 admin admin] PATH_INFO: `/v3/projects/84e81382caa043e3acd3990a0cb6b497/users/ee9c1accb26741c58816371f6c96553a/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:01.312852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c3ba3-6559-499b-8f25-43caf64b24c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e81382caa043e3acd3990a0cb6b497, user_id=ee9c1accb26741c58816371f6c96553a, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:01.318548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c3ba3-6559-499b-8f25-43caf64b24c3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:01.545656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab2b0bcd7f54990be8c3cc78847b11e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:01.552619 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab2b0bcd7f54990be8c3cc78847b11e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:01.570501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab2b0bcd7f54990be8c3cc78847b11e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:01.571187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab2b0bcd7f54990be8c3cc78847b11e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:01.571813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab2b0bcd7f54990be8c3cc78847b11e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:01.872967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1061/2122] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:00 2022] PUT /identity/v3/projects/84e81382caa043e3acd3990a0cb6b497/users/ee9c1accb26741c58816371f6c96553a/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:01.873406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1062/2123] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:00 2022] DELETE /identity/v3/users/9ab2b0bcd7f54990be8c3cc78847b11e => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:01.873983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c3ba3-6559-499b-8f25-43caf64b24c3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:01.876799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:01.879548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:01.881891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-017c3ba3-6559-499b-8f25-43caf64b24c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:01.924990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:02.040951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c3ba3-6559-499b-8f25-43caf64b24c3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.090140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e06ba6-49ed-4f21-a19f-d49adc5d4f1a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.100701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef6fe-2934-45cf-8ae6-5a94dcd71337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.102137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef6fe-2934-45cf-8ae6-5a94dcd71337 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.102600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef6fe-2934-45cf-8ae6-5a94dcd71337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.103039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef6fe-2934-45cf-8ae6-5a94dcd71337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.105370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bef6fe-2934-45cf-8ae6-5a94dcd71337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.109159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bef6fe-2934-45cf-8ae6-5a94dcd71337 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.129554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1063/2124] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:02.130689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef6fe-2934-45cf-8ae6-5a94dcd71337 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.133735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-01bef6fe-2934-45cf-8ae6-5a94dcd71337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:02.155875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef6fe-2934-45cf-8ae6-5a94dcd71337 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.161786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.162664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.163113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.163558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] PATH_INFO: `/v3/users/2a7072bd5bb74dd8bd0cc81ac2d1720f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.165542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7072bd5bb74dd8bd0cc81ac2d1720f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.168400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.171925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148e000-d9ac-40b1-9b95-f7dc2cfc113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.172543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148e000-d9ac-40b1-9b95-f7dc2cfc113d admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.173167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148e000-d9ac-40b1-9b95-f7dc2cfc113d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.173448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148e000-d9ac-40b1-9b95-f7dc2cfc113d admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.174080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148e000-d9ac-40b1-9b95-f7dc2cfc113d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.176966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148e000-d9ac-40b1-9b95-f7dc2cfc113d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.308560 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1062/2125] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:01 2022] POST /identity/v3/users => generated 293 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:02.313372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148e000-d9ac-40b1-9b95-f7dc2cfc113d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.326585 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148e000-d9ac-40b1-9b95-f7dc2cfc113d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.333047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af0ebf-2270-4d5d-8803-5357c836de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.333791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af0ebf-2270-4d5d-8803-5357c836de22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.334134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af0ebf-2270-4d5d-8803-5357c836de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.334598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af0ebf-2270-4d5d-8803-5357c836de22 admin admin] PATH_INFO: `/v3/projects/84e81382caa043e3acd3990a0cb6b497/users/ee9c1accb26741c58816371f6c96553a/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.337197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af0ebf-2270-4d5d-8803-5357c836de22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e81382caa043e3acd3990a0cb6b497, user_id=ee9c1accb26741c58816371f6c96553a, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.341075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af0ebf-2270-4d5d-8803-5357c836de22 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.357973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1063/2126] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:02 2022] PUT /identity/v3/projects/84e81382caa043e3acd3990a0cb6b497/users/ee9c1accb26741c58816371f6c96553a/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:02.357973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af0ebf-2270-4d5d-8803-5357c836de22 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.438980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7072bd5bb74dd8bd0cc81ac2d1720f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:02.446989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7072bd5bb74dd8bd0cc81ac2d1720f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:02.461638 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7072bd5bb74dd8bd0cc81ac2d1720f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:02.462497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7072bd5bb74dd8bd0cc81ac2d1720f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:02.463217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b993c768-cd30-4772-b619-5b9ac3f44684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7072bd5bb74dd8bd0cc81ac2d1720f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:02.481189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af0ebf-2270-4d5d-8803-5357c836de22 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.487655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010db526-ee85-4a67-a6d4-fdb61ea20a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.489382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010db526-ee85-4a67-a6d4-fdb61ea20a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.489382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010db526-ee85-4a67-a6d4-fdb61ea20a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.489382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010db526-ee85-4a67-a6d4-fdb61ea20a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.489653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010db526-ee85-4a67-a6d4-fdb61ea20a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.491299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010db526-ee85-4a67-a6d4-fdb61ea20a64 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.504116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1064/2127] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:02.508037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010db526-ee85-4a67-a6d4-fdb61ea20a64 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.511365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-010db526-ee85-4a67-a6d4-fdb61ea20a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:02.527195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010db526-ee85-4a67-a6d4-fdb61ea20a64 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.534083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979a38c-5da5-49aa-9457-72f420b44944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.534753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979a38c-5da5-49aa-9457-72f420b44944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.535054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979a38c-5da5-49aa-9457-72f420b44944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.535328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979a38c-5da5-49aa-9457-72f420b44944 admin admin] PATH_INFO: `/v3/projects/fb18745df87449d8a5d5fc5e7d73be16/users/f651470780644d98b5b04a56d3bb59bb/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.553757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979a38c-5da5-49aa-9457-72f420b44944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb18745df87449d8a5d5fc5e7d73be16, user_id=f651470780644d98b5b04a56d3bb59bb, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.556754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979a38c-5da5-49aa-9457-72f420b44944 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.582129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1064/2128] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:02 2022] DELETE /identity/v3/users/2a7072bd5bb74dd8bd0cc81ac2d1720f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:02.587585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af137b5-3b38-40c4-9538-4cc02847f05b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.589837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af137b5-3b38-40c4-9538-4cc02847f05b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.589837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af137b5-3b38-40c4-9538-4cc02847f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.618120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9af137b5-3b38-40c4-9538-4cc02847f05b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:02.619659 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9af137b5-3b38-40c4-9538-4cc02847f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:02.658345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1065/2129] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:02 2022] PUT /identity/v3/projects/fb18745df87449d8a5d5fc5e7d73be16/users/f651470780644d98b5b04a56d3bb59bb/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:02.660667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979a38c-5da5-49aa-9457-72f420b44944 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.663947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f979a38c-5da5-49aa-9457-72f420b44944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:02.746783 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1065/2130] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:02.748257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af137b5-3b38-40c4-9538-4cc02847f05b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.763281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af137b5-3b38-40c4-9538-4cc02847f05b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.835794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979a38c-5da5-49aa-9457-72f420b44944 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:02.854839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.855814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.856295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.856693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] PATH_INFO: `/v3/projects/440b935d8c70402a9c17ae0c02e4d340` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.860380 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=440b935d8c70402a9c17ae0c02e4d340)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.863025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.924451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b7db9-854a-4a99-bf1a-c851fd670995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:02.931159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b7db9-854a-4a99-bf1a-c851fd670995 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:02.931159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b7db9-854a-4a99-bf1a-c851fd670995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:02.931159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b7db9-854a-4a99-bf1a-c851fd670995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:02.931159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b7db9-854a-4a99-bf1a-c851fd670995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:02.935756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b7db9-854a-4a99-bf1a-c851fd670995 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:02.964369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1066/2131] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:02.965691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b7db9-854a-4a99-bf1a-c851fd670995 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:02.970958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-512b7db9-854a-4a99-bf1a-c851fd670995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.047605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440b935d8c70402a9c17ae0c02e4d340', 'request_id': 'req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:03.056643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440b935d8c70402a9c17ae0c02e4d340', 'request_id': 'req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:03.064946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440b935d8c70402a9c17ae0c02e4d340', 'request_id': 'req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:03.112082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b7db9-854a-4a99-bf1a-c851fd670995 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.149589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] The token cache is being invalidate because project 440b935d8c70402a9c17ae0c02e4d340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:03.150040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:03.151804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dc14e75b-f3aa-47a1-bb2b-91a091e7e05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:03.154818 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1066/2132] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:02 2022] DELETE /identity/v3/projects/440b935d8c70402a9c17ae0c02e4d340 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:03.156426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199905f1-8558-49bb-932a-a1b2804705eb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.156718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199905f1-8558-49bb-932a-a1b2804705eb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.160707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199905f1-8558-49bb-932a-a1b2804705eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.243251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-199905f1-8558-49bb-932a-a1b2804705eb None None] MFA Rules not processed for user `422f027c14884f5384f2ed2ff68c82f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:03.250581 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-199905f1-8558-49bb-932a-a1b2804705eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.263908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.265278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.265778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.266165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.269306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.383978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.387410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.408113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1067/2133] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:03.408963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.410413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.425423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d0571-ac18-4d7f-92c3-9b64d3dd274e service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.431086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635c21a-f05d-4c7f-9c67-12ed4d9603d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.431800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635c21a-f05d-4c7f-9c67-12ed4d9603d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.432732 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635c21a-f05d-4c7f-9c67-12ed4d9603d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.433012 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635c21a-f05d-4c7f-9c67-12ed4d9603d9 admin admin] PATH_INFO: `/v3/projects/fb18745df87449d8a5d5fc5e7d73be16/users/f651470780644d98b5b04a56d3bb59bb/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.439498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1067/2134] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:03.441193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00d796-94e9-4f48-96f5-63c7410e2498 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.447336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635c21a-f05d-4c7f-9c67-12ed4d9603d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb18745df87449d8a5d5fc5e7d73be16, user_id=f651470780644d98b5b04a56d3bb59bb, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.453197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:03.458223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00d796-94e9-4f48-96f5-63c7410e2498 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.458223 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00d796-94e9-4f48-96f5-63c7410e2498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.458454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635c21a-f05d-4c7f-9c67-12ed4d9603d9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.472002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1068/2135] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:03 2022] PUT /identity/v3/projects/fb18745df87449d8a5d5fc5e7d73be16/users/f651470780644d98b5b04a56d3bb59bb/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:03.472887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635c21a-f05d-4c7f-9c67-12ed4d9603d9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.474649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c635c21a-f05d-4c7f-9c67-12ed4d9603d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.509467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ae00d796-94e9-4f48-96f5-63c7410e2498 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:03.511255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae00d796-94e9-4f48-96f5-63c7410e2498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.556519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635c21a-f05d-4c7f-9c67-12ed4d9603d9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.564472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964533b-f47d-49d1-a7f0-52b9e75df8a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.565650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964533b-f47d-49d1-a7f0-52b9e75df8a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.565933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964533b-f47d-49d1-a7f0-52b9e75df8a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.566672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964533b-f47d-49d1-a7f0-52b9e75df8a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.662839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1068/2136] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:03.664172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbd147-bbcc-472e-88ea-733043de36af None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.664461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbd147-bbcc-472e-88ea-733043de36af None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.664740 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbd147-bbcc-472e-88ea-733043de36af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.712675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964533b-f47d-49d1-a7f0-52b9e75df8a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.714167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964533b-f47d-49d1-a7f0-52b9e75df8a6 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.745287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-80bbd147-bbcc-472e-88ea-733043de36af None None] MFA Rules not processed for user `f651470780644d98b5b04a56d3bb59bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:03.746892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-80bbd147-bbcc-472e-88ea-733043de36af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.749074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1069/2137] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:03.750669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf58d8-51ec-4a75-8da6-bb96bd51369e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.751160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf58d8-51ec-4a75-8da6-bb96bd51369e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.751466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf58d8-51ec-4a75-8da6-bb96bd51369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.797485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-03cf58d8-51ec-4a75-8da6-bb96bd51369e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:03.800430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-03cf58d8-51ec-4a75-8da6-bb96bd51369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.822730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1070/2138] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:03.826510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf58d8-51ec-4a75-8da6-bb96bd51369e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.841487 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf58d8-51ec-4a75-8da6-bb96bd51369e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.856234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912e971-ea42-4a41-8d19-bbc390402081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.856866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912e971-ea42-4a41-8d19-bbc390402081 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.857149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912e971-ea42-4a41-8d19-bbc390402081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.857422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912e971-ea42-4a41-8d19-bbc390402081 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.858146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912e971-ea42-4a41-8d19-bbc390402081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:03.858962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912e971-ea42-4a41-8d19-bbc390402081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.863718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912e971-ea42-4a41-8d19-bbc390402081 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.895867 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1071/2139] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:03.898557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912e971-ea42-4a41-8d19-bbc390402081 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.909657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1069/2140] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:03.914507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912e971-ea42-4a41-8d19-bbc390402081 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.924111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbd147-bbcc-472e-88ea-733043de36af None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:03.925640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-80bbd147-bbcc-472e-88ea-733043de36af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:03.940478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283125bf-be11-4bf2-98f3-37dc7a45d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.941786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283125bf-be11-4bf2-98f3-37dc7a45d8bc admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.942308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283125bf-be11-4bf2-98f3-37dc7a45d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.942591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283125bf-be11-4bf2-98f3-37dc7a45d8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.943243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283125bf-be11-4bf2-98f3-37dc7a45d8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.945217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283125bf-be11-4bf2-98f3-37dc7a45d8bc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:03.950967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbd147-bbcc-472e-88ea-733043de36af None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:03.956701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff9658-312e-4961-8f3a-518b4cbca118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:03.957791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9658-312e-4961-8f3a-518b4cbca118 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:03.957791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9658-312e-4961-8f3a-518b4cbca118 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:03.957975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9658-312e-4961-8f3a-518b4cbca118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:03.970679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff9658-312e-4961-8f3a-518b4cbca118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:03.976366 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff9658-312e-4961-8f3a-518b4cbca118 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.008252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1070/2141] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:04.157008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1072/2142] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:03 2022] POST /identity/v3/projects => generated 379 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:04.161931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff9658-312e-4961-8f3a-518b4cbca118 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.194098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff9658-312e-4961-8f3a-518b4cbca118 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.374949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27f8a-ed39-49b1-be83-6041f3ec4aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.376867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27f8a-ed39-49b1-be83-6041f3ec4aed admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.377319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27f8a-ed39-49b1-be83-6041f3ec4aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.377748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27f8a-ed39-49b1-be83-6041f3ec4aed admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.378544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a27f8a-ed39-49b1-be83-6041f3ec4aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.382291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a27f8a-ed39-49b1-be83-6041f3ec4aed admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.482202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1071/2143] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:04 2022] POST /identity/v3/users => generated 290 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:04.487303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283125bf-be11-4bf2-98f3-37dc7a45d8bc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.498571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283125bf-be11-4bf2-98f3-37dc7a45d8bc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.512951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27586a-1e68-48c7-8ac1-6d7dcaad0be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.514070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27586a-1e68-48c7-8ac1-6d7dcaad0be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.514591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27586a-1e68-48c7-8ac1-6d7dcaad0be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.516108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27586a-1e68-48c7-8ac1-6d7dcaad0be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.517017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27586a-1e68-48c7-8ac1-6d7dcaad0be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.519071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27586a-1e68-48c7-8ac1-6d7dcaad0be3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.544550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1073/2144] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:04.549708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27f8a-ed39-49b1-be83-6041f3ec4aed admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.565300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27f8a-ed39-49b1-be83-6041f3ec4aed admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.576334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911abe2-6599-40c3-88a7-87af128abc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.576629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911abe2-6599-40c3-88a7-87af128abc78 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.576940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911abe2-6599-40c3-88a7-87af128abc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.577293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911abe2-6599-40c3-88a7-87af128abc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.581119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911abe2-6599-40c3-88a7-87af128abc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.593190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911abe2-6599-40c3-88a7-87af128abc78 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.617595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1072/2145] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:04.622162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27586a-1e68-48c7-8ac1-6d7dcaad0be3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.661575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27586a-1e68-48c7-8ac1-6d7dcaad0be3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:04.668170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093a119-6135-4f13-81cc-eb361cfcc151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:04.668920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a119-6135-4f13-81cc-eb361cfcc151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.669415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a119-6135-4f13-81cc-eb361cfcc151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.669757 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a119-6135-4f13-81cc-eb361cfcc151 admin admin] PATH_INFO: `/v3/projects/07d0205d99b5428782f6a686504396f4/users/38913aea38dc41dc88304dad33d16171/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.698162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093a119-6135-4f13-81cc-eb361cfcc151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d0205d99b5428782f6a686504396f4, user_id=38913aea38dc41dc88304dad33d16171, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:04.702224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093a119-6135-4f13-81cc-eb361cfcc151 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:04.737487 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:04.805953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1074/2146] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:04 2022] PUT /identity/v3/projects/07d0205d99b5428782f6a686504396f4/users/38913aea38dc41dc88304dad33d16171/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:04.816280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9c09a-5b4f-49c2-a253-502b0ddd2eff None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:04.816674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9c09a-5b4f-49c2-a253-502b0ddd2eff None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:04.817070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9c09a-5b4f-49c2-a253-502b0ddd2eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:04.867285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d3f9c09a-5b4f-49c2-a253-502b0ddd2eff None None] MFA Rules not processed for user `38913aea38dc41dc88304dad33d16171`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:04.869009 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d3f9c09a-5b4f-49c2-a253-502b0ddd2eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:04.878044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093a119-6135-4f13-81cc-eb361cfcc151 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:04.882281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b093a119-6135-4f13-81cc-eb361cfcc151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.072289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1073/2147] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:05.079493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa10ac-c299-4fbf-b048-6074384ae986 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.083916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa10ac-c299-4fbf-b048-6074384ae986 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.086564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa10ac-c299-4fbf-b048-6074384ae986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.113692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093a119-6135-4f13-81cc-eb361cfcc151 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.130784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.131443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.131719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.134924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] PATH_INFO: `/v3/projects/84dd600cf4b5416393fa00530a079ca8` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.135163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=84dd600cf4b5416393fa00530a079ca8)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.138290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.175165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-58fa10ac-c299-4fbf-b048-6074384ae986 None None] MFA Rules not processed for user `ee9c1accb26741c58816371f6c96553a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:05.178286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-58fa10ac-c299-4fbf-b048-6074384ae986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.336601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84dd600cf4b5416393fa00530a079ca8', 'request_id': 'req-e517a9f9-0a74-4a69-bb64-a290b43008cb'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:05.349563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1074/2148] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:05.349563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa10ac-c299-4fbf-b048-6074384ae986 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.364152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa10ac-c299-4fbf-b048-6074384ae986 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.384889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:05.399919 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84dd600cf4b5416393fa00530a079ca8', 'request_id': 'req-e517a9f9-0a74-4a69-bb64-a290b43008cb'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:05.515728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84dd600cf4b5416393fa00530a079ca8', 'request_id': 'req-e517a9f9-0a74-4a69-bb64-a290b43008cb'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:05.522008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3cfed-379d-4f75-87bb-05b9d570cdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.523440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3cfed-379d-4f75-87bb-05b9d570cdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.524207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3cfed-379d-4f75-87bb-05b9d570cdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.524794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3cfed-379d-4f75-87bb-05b9d570cdd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.525670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3cfed-379d-4f75-87bb-05b9d570cdd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.527947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3cfed-379d-4f75-87bb-05b9d570cdd3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.533510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] The token cache is being invalidate because project 84dd600cf4b5416393fa00530a079ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:05.534053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:05.534931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e517a9f9-0a74-4a69-bb64-a290b43008cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:05.537083 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1075/2149] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:04 2022] DELETE /identity/v3/projects/84dd600cf4b5416393fa00530a079ca8 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:05.538606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d741f-6c34-487e-bbeb-83a09a022de7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.539084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d741f-6c34-487e-bbeb-83a09a022de7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.539502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d741f-6c34-487e-bbeb-83a09a022de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.568080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-037d741f-6c34-487e-bbeb-83a09a022de7 None None] MFA Rules not processed for user `a3aa8fadbea6427782aee1f1d2634ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:05.569620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-037d741f-6c34-487e-bbeb-83a09a022de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.635243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1076/2150] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:05.636451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d741f-6c34-487e-bbeb-83a09a022de7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.637899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-037d741f-6c34-487e-bbeb-83a09a022de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.669130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1075/2151] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:05 2022] POST /identity/v3/projects => generated 377 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:05.669130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3cfed-379d-4f75-87bb-05b9d570cdd3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.672498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2ac3cfed-379d-4f75-87bb-05b9d570cdd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.683080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d741f-6c34-487e-bbeb-83a09a022de7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.688009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:05.783226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3cfed-379d-4f75-87bb-05b9d570cdd3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.794942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.795997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.797155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.797434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.797750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] PATH_INFO: `/v3/users/6c0c1a60495048f18e49034a6568b065` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.798527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.798823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.800319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.801248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0c1a60495048f18e49034a6568b065)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.804893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.806322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.906814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.908573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:05.920710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1076/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:05.927984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:05.927984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:05.938234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68045329-3cbc-49bf-85d1-54eb17990f4c service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:05.957141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:05.957969 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:05.958337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:05.958684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] PATH_INFO: `/v3/users/440f055de76c4b60bf8e6669f3c85c1b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:05.960383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440f055de76c4b60bf8e6669f3c85c1b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:05.963020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.130917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0c1a60495048f18e49034a6568b065'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.177792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0c1a60495048f18e49034a6568b065'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.212758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0c1a60495048f18e49034a6568b065'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.215139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0c1a60495048f18e49034a6568b065'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.217310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0c1a60495048f18e49034a6568b065'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.293991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440f055de76c4b60bf8e6669f3c85c1b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.294790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440f055de76c4b60bf8e6669f3c85c1b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.338915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1077/2153] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:05 2022] DELETE /identity/v3/users/6c0c1a60495048f18e49034a6568b065 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:06.340245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.344016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:06.383233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440f055de76c4b60bf8e6669f3c85c1b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.384168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440f055de76c4b60bf8e6669f3c85c1b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.413092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6f2d94b6-3d52-48d0-a2c2-4be72cdae869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440f055de76c4b60bf8e6669f3c85c1b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:06.448806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1077/2154] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:05 2022] DELETE /identity/v3/users/440f055de76c4b60bf8e6669f3c85c1b => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:06.453463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f66e4-9f48-4b5f-b897-47f9823fcb2d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.453754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f66e4-9f48-4b5f-b897-47f9823fcb2d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.454031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f66e4-9f48-4b5f-b897-47f9823fcb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.495358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d55f66e4-9f48-4b5f-b897-47f9823fcb2d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:06.496681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d55f66e4-9f48-4b5f-b897-47f9823fcb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:06.502127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96887cd-450c-4bfe-b011-da89bd33c245 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.582343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1078/2155] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:06.610639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f66e4-9f48-4b5f-b897-47f9823fcb2d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.612429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d55f66e4-9f48-4b5f-b897-47f9823fcb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:06.647343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39825cfb-7ace-4919-9ca5-6cc870ad2920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.650181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39825cfb-7ace-4919-9ca5-6cc870ad2920 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.650181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39825cfb-7ace-4919-9ca5-6cc870ad2920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.650181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39825cfb-7ace-4919-9ca5-6cc870ad2920 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.650463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39825cfb-7ace-4919-9ca5-6cc870ad2920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.652518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39825cfb-7ace-4919-9ca5-6cc870ad2920 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.754485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f66e4-9f48-4b5f-b897-47f9823fcb2d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.763517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1078/2156] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:06 2022] POST /identity/v3/users => generated 295 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:06.763678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454725-5281-43ed-a40c-0f5c1b222ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.765210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454725-5281-43ed-a40c-0f5c1b222ead service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.765428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454725-5281-43ed-a40c-0f5c1b222ead service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.767222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454725-5281-43ed-a40c-0f5c1b222ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.769561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39825cfb-7ace-4919-9ca5-6cc870ad2920 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.775505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-39825cfb-7ace-4919-9ca5-6cc870ad2920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:06.788747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57454725-5281-43ed-a40c-0f5c1b222ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.790351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57454725-5281-43ed-a40c-0f5c1b222ead service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.801040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39825cfb-7ace-4919-9ca5-6cc870ad2920 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.822801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72971f7f-db48-4215-9de8-d6a6993afb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.822801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72971f7f-db48-4215-9de8-d6a6993afb95 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.822801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72971f7f-db48-4215-9de8-d6a6993afb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.822801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72971f7f-db48-4215-9de8-d6a6993afb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.823357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72971f7f-db48-4215-9de8-d6a6993afb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.823641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1079/2157] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:06.823719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72971f7f-db48-4215-9de8-d6a6993afb95 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.837838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1079/2158] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:06.841867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454725-5281-43ed-a40c-0f5c1b222ead service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:06.857281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454725-5281-43ed-a40c-0f5c1b222ead service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:06.863983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07baab-c8ae-4eef-b8b0-7cc66af1b522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:06.864737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07baab-c8ae-4eef-b8b0-7cc66af1b522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.865076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07baab-c8ae-4eef-b8b0-7cc66af1b522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.865414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07baab-c8ae-4eef-b8b0-7cc66af1b522 admin admin] PATH_INFO: `/v3/projects/f7cc7532472d49de9662c7aef0043a51/users/0d9917718b33419394c1db600b8e2cc5/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:06.913173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07baab-c8ae-4eef-b8b0-7cc66af1b522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cc7532472d49de9662c7aef0043a51, user_id=0d9917718b33419394c1db600b8e2cc5, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:06.920583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07baab-c8ae-4eef-b8b0-7cc66af1b522 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:06.993277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f84a0-ec65-455d-abdc-76a535917d24 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:06.993897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f84a0-ec65-455d-abdc-76a535917d24 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:06.995518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f84a0-ec65-455d-abdc-76a535917d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.009455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1080/2159] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:06 2022] PUT /identity/v3/projects/f7cc7532472d49de9662c7aef0043a51/users/0d9917718b33419394c1db600b8e2cc5/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:07.017647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07baab-c8ae-4eef-b8b0-7cc66af1b522 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.045023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8a1f84a0-ec65-455d-abdc-76a535917d24 None None] MFA Rules not processed for user `422f027c14884f5384f2ed2ff68c82f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:07.048703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8a1f84a0-ec65-455d-abdc-76a535917d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:07.131023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:07.174342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1080/2160] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:07.238952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07baab-c8ae-4eef-b8b0-7cc66af1b522 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.273183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c3be1-57b4-4678-8189-f4be53c67b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.273905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c3be1-57b4-4678-8189-f4be53c67b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.274276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c3be1-57b4-4678-8189-f4be53c67b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.274550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c3be1-57b4-4678-8189-f4be53c67b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.276265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c3be1-57b4-4678-8189-f4be53c67b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.277977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c3be1-57b4-4678-8189-f4be53c67b82 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.296360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1081/2161] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:07.297823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f84a0-ec65-455d-abdc-76a535917d24 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.310770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f84a0-ec65-455d-abdc-76a535917d24 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.317937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ccc5a-ffdd-4bf9-9fc3-6de7b8bd8283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.318626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ccc5a-ffdd-4bf9-9fc3-6de7b8bd8283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.318960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ccc5a-ffdd-4bf9-9fc3-6de7b8bd8283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.319241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ccc5a-ffdd-4bf9-9fc3-6de7b8bd8283 admin admin] PATH_INFO: `/v3/projects/f7cc7532472d49de9662c7aef0043a51/users/0d9917718b33419394c1db600b8e2cc5/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.321968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ccc5a-ffdd-4bf9-9fc3-6de7b8bd8283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cc7532472d49de9662c7aef0043a51, user_id=0d9917718b33419394c1db600b8e2cc5, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.325283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ccc5a-ffdd-4bf9-9fc3-6de7b8bd8283 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.339532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1081/2162] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:07 2022] PUT /identity/v3/projects/f7cc7532472d49de9662c7aef0043a51/users/0d9917718b33419394c1db600b8e2cc5/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:07.350053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19818b2-c559-4fb8-a49b-e74783672ccf None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.350398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19818b2-c559-4fb8-a49b-e74783672ccf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.350613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19818b2-c559-4fb8-a49b-e74783672ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.423850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:07.426377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c19818b2-c559-4fb8-a49b-e74783672ccf None None] MFA Rules not processed for user `0d9917718b33419394c1db600b8e2cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:07.427619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c19818b2-c559-4fb8-a49b-e74783672ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:07.532163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ccc5a-ffdd-4bf9-9fc3-6de7b8bd8283 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.532163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-280ccc5a-ffdd-4bf9-9fc3-6de7b8bd8283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:07.661594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1082/2163] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:07.664139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19818b2-c559-4fb8-a49b-e74783672ccf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:07.668190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c19818b2-c559-4fb8-a49b-e74783672ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:07.742413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ccc5a-ffdd-4bf9-9fc3-6de7b8bd8283 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.753535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.755267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.755675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.755997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] PATH_INFO: `/v3/projects/8793d09e72fc45f28f24b6e568b0a5b7` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.759011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8793d09e72fc45f28f24b6e568b0a5b7)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.761522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.833621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19818b2-c559-4fb8-a49b-e74783672ccf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:07.848343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:07.849499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:07.849781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:07.850060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] PATH_INFO: `/v3/projects/94f5bede59024f89b54f6b63c76da92e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:07.851916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f5bede59024f89b54f6b63c76da92e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:07.854110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:07.950241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8793d09e72fc45f28f24b6e568b0a5b7', 'request_id': 'req-be3f8bf2-54f6-4ed5-af21-05b86815da0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:07.958483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8793d09e72fc45f28f24b6e568b0a5b7', 'request_id': 'req-be3f8bf2-54f6-4ed5-af21-05b86815da0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:08.096506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f5bede59024f89b54f6b63c76da92e', 'request_id': 'req-63f2828a-f4e3-43d0-ab02-15842b82f446'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:08.109389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f5bede59024f89b54f6b63c76da92e', 'request_id': 'req-63f2828a-f4e3-43d0-ab02-15842b82f446'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:08.118592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f5bede59024f89b54f6b63c76da92e', 'request_id': 'req-63f2828a-f4e3-43d0-ab02-15842b82f446'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:08.144691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8793d09e72fc45f28f24b6e568b0a5b7', 'request_id': 'req-be3f8bf2-54f6-4ed5-af21-05b86815da0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:08.169036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] The token cache is being invalidate because project 8793d09e72fc45f28f24b6e568b0a5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:08.170023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:08.175037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:08.178217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1082/2164] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:07 2022] DELETE /identity/v3/projects/8793d09e72fc45f28f24b6e568b0a5b7 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:08.179295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.182702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:08.262917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f8bf2-54f6-4ed5-af21-05b86815da0d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.323265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] The token cache is being invalidate because project 94f5bede59024f89b54f6b63c76da92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:08.323695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:08.333995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-63f2828a-f4e3-43d0-ab02-15842b82f446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:08.336165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1083/2165] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:07 2022] DELETE /identity/v3/projects/94f5bede59024f89b54f6b63c76da92e => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:08.337368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1628-ba66-4c6c-97f4-ff45f4d0c244 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.337656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1628-ba66-4c6c-97f4-ff45f4d0c244 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.337929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1628-ba66-4c6c-97f4-ff45f4d0c244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.345299 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed891f8f-cc2a-4f8c-8527-7a1c06d68714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.346547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed891f8f-cc2a-4f8c-8527-7a1c06d68714 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.347073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed891f8f-cc2a-4f8c-8527-7a1c06d68714 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.347495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed891f8f-cc2a-4f8c-8527-7a1c06d68714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.349459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ed891f8f-cc2a-4f8c-8527-7a1c06d68714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:08.391777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-dfde1628-ba66-4c6c-97f4-ff45f4d0c244 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:08.393841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dfde1628-ba66-4c6c-97f4-ff45f4d0c244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:08.475917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1084/2166] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:08.477053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde1628-ba66-4c6c-97f4-ff45f4d0c244 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.479063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dfde1628-ba66-4c6c-97f4-ff45f4d0c244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:08.493004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed891f8f-cc2a-4f8c-8527-7a1c06d68714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.494221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde1628-ba66-4c6c-97f4-ff45f4d0c244 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.496018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed891f8f-cc2a-4f8c-8527-7a1c06d68714 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.502090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.504883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.504883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.504883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] PATH_INFO: `/v3/users/f651470780644d98b5b04a56d3bb59bb` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.506144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f651470780644d98b5b04a56d3bb59bb)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.508389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.520999 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1083/2167] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:08.524331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a0a7b-8470-489a-8545-afe88b7f6cd6 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.525428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a0a7b-8470-489a-8545-afe88b7f6cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.526100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a0a7b-8470-489a-8545-afe88b7f6cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.594833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ec9a0a7b-8470-489a-8545-afe88b7f6cd6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:08.597911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ec9a0a7b-8470-489a-8545-afe88b7f6cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:08.676672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1084/2168] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:08.680071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a0a7b-8470-489a-8545-afe88b7f6cd6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.761928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a0a7b-8470-489a-8545-afe88b7f6cd6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.780346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209fd72-5b60-4629-ad3e-19620be89b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.780346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209fd72-5b60-4629-ad3e-19620be89b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.780346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209fd72-5b60-4629-ad3e-19620be89b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.780346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209fd72-5b60-4629-ad3e-19620be89b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.780752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209fd72-5b60-4629-ad3e-19620be89b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:08.780752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209fd72-5b60-4629-ad3e-19620be89b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.784994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209fd72-5b60-4629-ad3e-19620be89b75 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:08.831105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1085/2169] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:08.832979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209fd72-5b60-4629-ad3e-19620be89b75 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:08.871957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209fd72-5b60-4629-ad3e-19620be89b75 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:08.914810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c32146-dd9e-4a4b-89a7-f9d8cb8ab80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:08.915626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c32146-dd9e-4a4b-89a7-f9d8cb8ab80c admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:08.916028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c32146-dd9e-4a4b-89a7-f9d8cb8ab80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:08.916396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c32146-dd9e-4a4b-89a7-f9d8cb8ab80c admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:08.917135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c32146-dd9e-4a4b-89a7-f9d8cb8ab80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:08.919298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c32146-dd9e-4a4b-89a7-f9d8cb8ab80c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:09.505841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f651470780644d98b5b04a56d3bb59bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:09.506478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f651470780644d98b5b04a56d3bb59bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:09.565656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1086/2170] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:08 2022] POST /identity/v3/projects => generated 385 bytes in 733 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:09.569624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c32146-dd9e-4a4b-89a7-f9d8cb8ab80c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:09.675395 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f651470780644d98b5b04a56d3bb59bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:09.677180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f651470780644d98b5b04a56d3bb59bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:09.719630 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f651470780644d98b5b04a56d3bb59bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:09.759919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1085/2171] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:08 2022] DELETE /identity/v3/users/f651470780644d98b5b04a56d3bb59bb => generated 0 bytes in 1283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:09.777857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c32146-dd9e-4a4b-89a7-f9d8cb8ab80c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:09.916711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf214c5-eb73-4218-a11f-d2b52aad0dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:09.918616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf214c5-eb73-4218-a11f-d2b52aad0dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:09.919284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf214c5-eb73-4218-a11f-d2b52aad0dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:09.919573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf214c5-eb73-4218-a11f-d2b52aad0dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:09.921146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf214c5-eb73-4218-a11f-d2b52aad0dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:09.932340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf214c5-eb73-4218-a11f-d2b52aad0dc9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.129479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1087/2172] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:09 2022] POST /identity/v3/users => generated 293 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:10.133676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.135222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:10.156205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10b594-6622-48ec-b893-194e719df039 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:10.171497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fa15a-29d4-4c4a-a2ff-5123983d75a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:10.171497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa15a-29d4-4c4a-a2ff-5123983d75a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.171497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa15a-29d4-4c4a-a2ff-5123983d75a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.171497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fa15a-29d4-4c4a-a2ff-5123983d75a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.171939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fa15a-29d4-4c4a-a2ff-5123983d75a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:10.173167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fa15a-29d4-4c4a-a2ff-5123983d75a3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.216913 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1086/2173] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:10.220803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf214c5-eb73-4218-a11f-d2b52aad0dc9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.254727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf214c5-eb73-4218-a11f-d2b52aad0dc9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:10.266759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308212f-98e6-42b1-be61-1893e4ceb4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:10.267962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308212f-98e6-42b1-be61-1893e4ceb4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.268236 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308212f-98e6-42b1-be61-1893e4ceb4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.268514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308212f-98e6-42b1-be61-1893e4ceb4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.269175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308212f-98e6-42b1-be61-1893e4ceb4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:10.270801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308212f-98e6-42b1-be61-1893e4ceb4c0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.308342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1088/2174] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:10.310629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fa15a-29d4-4c4a-a2ff-5123983d75a3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.377611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fa15a-29d4-4c4a-a2ff-5123983d75a3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:10.406306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743b46f-a653-495e-bef7-eb34be8b3486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:10.408793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743b46f-a653-495e-bef7-eb34be8b3486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.412504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743b46f-a653-495e-bef7-eb34be8b3486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.414895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743b46f-a653-495e-bef7-eb34be8b3486 admin admin] PATH_INFO: `/v3/projects/e071dee89f604c6d8983e3e5dd0db2b4/users/45a512d2e2f646608c2fdb5b44dfc2b9/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.468305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743b46f-a653-495e-bef7-eb34be8b3486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e071dee89f604c6d8983e3e5dd0db2b4, user_id=45a512d2e2f646608c2fdb5b44dfc2b9, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:10.472230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743b46f-a653-495e-bef7-eb34be8b3486 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:10.831868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1087/2175] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:10 2022] PUT /identity/v3/projects/e071dee89f604c6d8983e3e5dd0db2b4/users/45a512d2e2f646608c2fdb5b44dfc2b9/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:10.833813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ba01b-8c29-4d5d-b141-bad15b053dcb None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:10.834438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ba01b-8c29-4d5d-b141-bad15b053dcb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:10.834438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ba01b-8c29-4d5d-b141-bad15b053dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:10.883397 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743b46f-a653-495e-bef7-eb34be8b3486 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:10.887710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0743b46f-a653-495e-bef7-eb34be8b3486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:10.904139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1d7ba01b-8c29-4d5d-b141-bad15b053dcb None None] MFA Rules not processed for user `45a512d2e2f646608c2fdb5b44dfc2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:10.904139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1d7ba01b-8c29-4d5d-b141-bad15b053dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:11.048188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743b46f-a653-495e-bef7-eb34be8b3486 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.053973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1089/2176] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:11.062945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.064241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.064808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.066310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] PATH_INFO: `/v3/projects/fb18745df87449d8a5d5fc5e7d73be16` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.068138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb18745df87449d8a5d5fc5e7d73be16)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:11.070635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:11.081005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ba01b-8c29-4d5d-b141-bad15b053dcb None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:11.082700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1d7ba01b-8c29-4d5d-b141-bad15b053dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:11.161854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ba01b-8c29-4d5d-b141-bad15b053dcb None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.166615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5dfeb-423f-42e8-afbc-40abea860404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.167346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5dfeb-423f-42e8-afbc-40abea860404 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.167764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5dfeb-423f-42e8-afbc-40abea860404 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.168150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5dfeb-423f-42e8-afbc-40abea860404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.193317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5dfeb-423f-42e8-afbc-40abea860404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:11.194595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5dfeb-423f-42e8-afbc-40abea860404 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:11.205670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1090/2177] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:11.311044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb18745df87449d8a5d5fc5e7d73be16', 'request_id': 'req-afaed0ea-55be-4175-ae25-a207b0ff20f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:11.320623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb18745df87449d8a5d5fc5e7d73be16', 'request_id': 'req-afaed0ea-55be-4175-ae25-a207b0ff20f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:11.368235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb18745df87449d8a5d5fc5e7d73be16', 'request_id': 'req-afaed0ea-55be-4175-ae25-a207b0ff20f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:11.452329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] The token cache is being invalidate because project fb18745df87449d8a5d5fc5e7d73be16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:11.454331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:11.457456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-afaed0ea-55be-4175-ae25-a207b0ff20f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:11.463325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1088/2178] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:10 2022] DELETE /identity/v3/projects/fb18745df87449d8a5d5fc5e7d73be16 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:11.464560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fef3f5-8a42-4bb1-84bb-6940683bb452 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.464868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fef3f5-8a42-4bb1-84bb-6940683bb452 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.465195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fef3f5-8a42-4bb1-84bb-6940683bb452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.511791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f6fef3f5-8a42-4bb1-84bb-6940683bb452 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:11.513740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f6fef3f5-8a42-4bb1-84bb-6940683bb452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:11.579634 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad629d9-66d1-45de-bebd-eee2d57edd6b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.579980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad629d9-66d1-45de-bebd-eee2d57edd6b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.580267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad629d9-66d1-45de-bebd-eee2d57edd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.608848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bad629d9-66d1-45de-bebd-eee2d57edd6b None None] MFA Rules not processed for user `58a762e958144f0bb9cf0a9ab5a91032`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:11.613063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bad629d9-66d1-45de-bebd-eee2d57edd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:11.692067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1091/2179] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:11.694705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd061e-5430-4b27-8ca5-fa3219b955ef None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.695040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd061e-5430-4b27-8ca5-fa3219b955ef None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.695372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd061e-5430-4b27-8ca5-fa3219b955ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.709496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1089/2180] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:11.709496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f255-7697-4e87-88be-2717bc41ec58 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.709496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f255-7697-4e87-88be-2717bc41ec58 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.709496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f255-7697-4e87-88be-2717bc41ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.737664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-58f9f255-7697-4e87-88be-2717bc41ec58 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:11.739688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-58f9f255-7697-4e87-88be-2717bc41ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:11.752507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1090/2181] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:11.756701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9f255-7697-4e87-88be-2717bc41ec58 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:11.768822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-38dd061e-5430-4b27-8ca5-fa3219b955ef None None] MFA Rules not processed for user `ef569b9142a14d4e924af8692e75065a`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:11.768822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-38dd061e-5430-4b27-8ca5-fa3219b955ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:11.769173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9f255-7697-4e87-88be-2717bc41ec58 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.774280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87842a47-4ad4-45fb-a51e-c9ef3fdf7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.775110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842a47-4ad4-45fb-a51e-c9ef3fdf7a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.775565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842a47-4ad4-45fb-a51e-c9ef3fdf7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.776160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87842a47-4ad4-45fb-a51e-c9ef3fdf7a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.777017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87842a47-4ad4-45fb-a51e-c9ef3fdf7a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:11.777500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87842a47-4ad4-45fb-a51e-c9ef3fdf7a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:11.779239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87842a47-4ad4-45fb-a51e-c9ef3fdf7a15 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:11.804978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1091/2182] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:11.814141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87842a47-4ad4-45fb-a51e-c9ef3fdf7a15 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:11.830214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87842a47-4ad4-45fb-a51e-c9ef3fdf7a15 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:11.835932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234e906-e6e8-4243-b1f9-def8802b736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:11.836568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234e906-e6e8-4243-b1f9-def8802b736d admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.836844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234e906-e6e8-4243-b1f9-def8802b736d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.837119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234e906-e6e8-4243-b1f9-def8802b736d admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.837859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234e906-e6e8-4243-b1f9-def8802b736d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:11.840098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234e906-e6e8-4243-b1f9-def8802b736d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:11.858402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1092/2183] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:11.861126 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b0821-0345-418d-940d-7d9fa8689331 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:11.861443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b0821-0345-418d-940d-7d9fa8689331 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:11.861721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b0821-0345-418d-940d-7d9fa8689331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:11.883416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-283b0821-0345-418d-940d-7d9fa8689331 None None] MFA Rules not processed for user `ef569b9142a14d4e924af8692e75065a`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:11.884687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-283b0821-0345-418d-940d-7d9fa8689331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:11.894275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1093/2184] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:11.906123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b0821-0345-418d-940d-7d9fa8689331 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:11.908757 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-283b0821-0345-418d-940d-7d9fa8689331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:11.955082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:11.967808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1092/2185] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:11 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:11.969273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234e906-e6e8-4243-b1f9-def8802b736d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.028373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b0821-0345-418d-940d-7d9fa8689331 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.057842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234e906-e6e8-4243-b1f9-def8802b736d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.066078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab1965-f682-4261-a8d5-f853042a67e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.066780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab1965-f682-4261-a8d5-f853042a67e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.066968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab1965-f682-4261-a8d5-f853042a67e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.067482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab1965-f682-4261-a8d5-f853042a67e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.088623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab1965-f682-4261-a8d5-f853042a67e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.091531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab1965-f682-4261-a8d5-f853042a67e6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.130647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebc24e-d7f3-457a-8655-d9561bd63902 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.131405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebc24e-d7f3-457a-8655-d9561bd63902 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.131579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebc24e-d7f3-457a-8655-d9561bd63902 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.131893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebc24e-d7f3-457a-8655-d9561bd63902 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.208235 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.213376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1093/2186] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:11 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:12.216952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab1965-f682-4261-a8d5-f853042a67e6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.234509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab1965-f682-4261-a8d5-f853042a67e6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.236095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebc24e-d7f3-457a-8655-d9561bd63902 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.237708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebc24e-d7f3-457a-8655-d9561bd63902 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.251139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1094/2187] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:12.251840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee3238-ab91-4172-ab43-d81f49034889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.252464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3238-ab91-4172-ab43-d81f49034889 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.252734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3238-ab91-4172-ab43-d81f49034889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.253013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3238-ab91-4172-ab43-d81f49034889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.253642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee3238-ab91-4172-ab43-d81f49034889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.255226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee3238-ab91-4172-ab43-d81f49034889 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.270988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1094/2188] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:12.274595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebc24e-d7f3-457a-8655-d9561bd63902 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.286441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebc24e-d7f3-457a-8655-d9561bd63902 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.292018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965096-22a8-4bcb-8392-cffe3d2fb568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.292725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965096-22a8-4bcb-8392-cffe3d2fb568 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.293005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965096-22a8-4bcb-8392-cffe3d2fb568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.293274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965096-22a8-4bcb-8392-cffe3d2fb568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.293921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965096-22a8-4bcb-8392-cffe3d2fb568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.295624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965096-22a8-4bcb-8392-cffe3d2fb568 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.311479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1095/2189] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:12.312507 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee3238-ab91-4172-ab43-d81f49034889 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.345342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee3238-ab91-4172-ab43-d81f49034889 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.345342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f6dc1-d767-4132-a1d8-ff2bde30a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.345342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f6dc1-d767-4132-a1d8-ff2bde30a29e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.345342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f6dc1-d767-4132-a1d8-ff2bde30a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.345850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f6dc1-d767-4132-a1d8-ff2bde30a29e admin admin] PATH_INFO: `/v3/projects/3eeb7d6efcb949f0a7c36ba2f091fb61/users/2c7a6b991c4b42e58b493b631a382149/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.365706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f6dc1-d767-4132-a1d8-ff2bde30a29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eeb7d6efcb949f0a7c36ba2f091fb61, user_id=2c7a6b991c4b42e58b493b631a382149, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.369769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f6dc1-d767-4132-a1d8-ff2bde30a29e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.470179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1095/2190] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:12 2022] PUT /identity/v3/projects/3eeb7d6efcb949f0a7c36ba2f091fb61/users/2c7a6b991c4b42e58b493b631a382149/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:12.482076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2be8-3d1c-4d0a-b167-2959c683f838 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.483870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2be8-3d1c-4d0a-b167-2959c683f838 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.483870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce2be8-3d1c-4d0a-b167-2959c683f838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.523199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-90ce2be8-3d1c-4d0a-b167-2959c683f838 None None] MFA Rules not processed for user `2c7a6b991c4b42e58b493b631a382149`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:12.529844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-90ce2be8-3d1c-4d0a-b167-2959c683f838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:12.667297 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1096/2191] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:12.674911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f6dc1-d767-4132-a1d8-ff2bde30a29e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.725463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2be8-3d1c-4d0a-b167-2959c683f838 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.727069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-90ce2be8-3d1c-4d0a-b167-2959c683f838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:12.769490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f6dc1-d767-4132-a1d8-ff2bde30a29e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.774566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea2b66-82ad-442a-aa4a-3a50ec0f9ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.775180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea2b66-82ad-442a-aa4a-3a50ec0f9ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.775917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea2b66-82ad-442a-aa4a-3a50ec0f9ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.775917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea2b66-82ad-442a-aa4a-3a50ec0f9ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.776554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea2b66-82ad-442a-aa4a-3a50ec0f9ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.778613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea2b66-82ad-442a-aa4a-3a50ec0f9ce1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:12.797095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce2be8-3d1c-4d0a-b167-2959c683f838 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:12.814824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83197206-b5a9-4770-adca-5b3f8c7c7974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:12.817657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83197206-b5a9-4770-adca-5b3f8c7c7974 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:12.817657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83197206-b5a9-4770-adca-5b3f8c7c7974 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:12.818440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83197206-b5a9-4770-adca-5b3f8c7c7974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:12.822947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-83197206-b5a9-4770-adca-5b3f8c7c7974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:12.972974 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1096/2192] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:12 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:12.975427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea2b66-82ad-442a-aa4a-3a50ec0f9ce1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:12.985589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83197206-b5a9-4770-adca-5b3f8c7c7974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:12.985985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:12.987178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83197206-b5a9-4770-adca-5b3f8c7c7974 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.049484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1097/2193] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:13.150252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea2b66-82ad-442a-aa4a-3a50ec0f9ce1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.156836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d57a1-5c53-4db9-9ea0-3e75bc1c3ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.157714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d57a1-5c53-4db9-9ea0-3e75bc1c3ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.158045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d57a1-5c53-4db9-9ea0-3e75bc1c3ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.158502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d57a1-5c53-4db9-9ea0-3e75bc1c3ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.159918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d57a1-5c53-4db9-9ea0-3e75bc1c3ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.161635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d57a1-5c53-4db9-9ea0-3e75bc1c3ac3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.280408 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1097/2194] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:12 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:13.299856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83197206-b5a9-4770-adca-5b3f8c7c7974 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.317073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83197206-b5a9-4770-adca-5b3f8c7c7974 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.335224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d4e6-5932-4ef9-8391-9691ae258f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.335224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d4e6-5932-4ef9-8391-9691ae258f2a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.335224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d4e6-5932-4ef9-8391-9691ae258f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.335224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d4e6-5932-4ef9-8391-9691ae258f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.335569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d4e6-5932-4ef9-8391-9691ae258f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.340229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d4e6-5932-4ef9-8391-9691ae258f2a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.369664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1098/2195] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:13.372326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d57a1-5c53-4db9-9ea0-3e75bc1c3ac3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.401485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d57a1-5c53-4db9-9ea0-3e75bc1c3ac3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.419104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfb795-2f43-4298-a7ae-ec3d25f79a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.419596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfb795-2f43-4298-a7ae-ec3d25f79a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.419919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfb795-2f43-4298-a7ae-ec3d25f79a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.420203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfb795-2f43-4298-a7ae-ec3d25f79a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.421836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfb795-2f43-4298-a7ae-ec3d25f79a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.423077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfb795-2f43-4298-a7ae-ec3d25f79a49 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.474816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1098/2196] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:13.479371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d4e6-5932-4ef9-8391-9691ae258f2a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.491498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d4e6-5932-4ef9-8391-9691ae258f2a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.496685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7311343-9107-4646-8a11-e02f6f78e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.497337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7311343-9107-4646-8a11-e02f6f78e038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.497618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7311343-9107-4646-8a11-e02f6f78e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.497887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7311343-9107-4646-8a11-e02f6f78e038 admin admin] PATH_INFO: `/v3/projects/6590f70a3a4b48eb90b28887376b701a/users/1cf99f243a4a4f62a18914d922850a41/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.514048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7311343-9107-4646-8a11-e02f6f78e038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6590f70a3a4b48eb90b28887376b701a, user_id=1cf99f243a4a4f62a18914d922850a41, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.517184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7311343-9107-4646-8a11-e02f6f78e038 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:13.618375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1099/2197] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:13 2022] PUT /identity/v3/projects/6590f70a3a4b48eb90b28887376b701a/users/1cf99f243a4a4f62a18914d922850a41/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:13.630023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8ec2d-dda8-4e4e-8410-3dbd47117ea6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.630487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8ec2d-dda8-4e4e-8410-3dbd47117ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.630917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8ec2d-dda8-4e4e-8410-3dbd47117ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.692332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-18c8ec2d-dda8-4e4e-8410-3dbd47117ea6 None None] MFA Rules not processed for user `1cf99f243a4a4f62a18914d922850a41`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:13.699903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-18c8ec2d-dda8-4e4e-8410-3dbd47117ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:13.719995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578213f-6e48-45fb-9fee-b82078817f53 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.720841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578213f-6e48-45fb-9fee-b82078817f53 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.720841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578213f-6e48-45fb-9fee-b82078817f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.746981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2578213f-6e48-45fb-9fee-b82078817f53 None None] MFA Rules not processed for user `ef569b9142a14d4e924af8692e75065a`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:13.748780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2578213f-6e48-45fb-9fee-b82078817f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:13.860539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1100/2198] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:13.864912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1099/2199] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:13.869176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578213f-6e48-45fb-9fee-b82078817f53 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:13.938687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578213f-6e48-45fb-9fee-b82078817f53 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:13.944234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a8298-4e53-40eb-ae27-aa4842f6c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:13.944849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a8298-4e53-40eb-ae27-aa4842f6c823 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:13.945133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a8298-4e53-40eb-ae27-aa4842f6c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:13.945438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a8298-4e53-40eb-ae27-aa4842f6c823 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:13.946155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a8298-4e53-40eb-ae27-aa4842f6c823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:13.948108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a8298-4e53-40eb-ae27-aa4842f6c823 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.058507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1101/2200] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:13 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:14.060293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8ec2d-dda8-4e4e-8410-3dbd47117ea6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.075724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8ec2d-dda8-4e4e-8410-3dbd47117ea6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.200257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d381d-43cd-45b0-923d-a789a512ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.200879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d381d-43cd-45b0-923d-a789a512ccc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.201155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d381d-43cd-45b0-923d-a789a512ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.201451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d381d-43cd-45b0-923d-a789a512ccc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.202947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d381d-43cd-45b0-923d-a789a512ccc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.214265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d381d-43cd-45b0-923d-a789a512ccc2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.242062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:14.308037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1100/2201] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:14 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:14.310010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a8298-4e53-40eb-ae27-aa4842f6c823 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.326408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a8298-4e53-40eb-ae27-aa4842f6c823 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.339227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29021f3d-f5b2-46a7-a5e8-77b45a130ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.346345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29021f3d-f5b2-46a7-a5e8-77b45a130ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.346345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29021f3d-f5b2-46a7-a5e8-77b45a130ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.346345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29021f3d-f5b2-46a7-a5e8-77b45a130ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.346345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29021f3d-f5b2-46a7-a5e8-77b45a130ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.346345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29021f3d-f5b2-46a7-a5e8-77b45a130ce0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.367465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1102/2202] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:14.371530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d381d-43cd-45b0-923d-a789a512ccc2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.384613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d381d-43cd-45b0-923d-a789a512ccc2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.403979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045bbcd-082d-4349-ab10-b9d43f306522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.403979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045bbcd-082d-4349-ab10-b9d43f306522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.403979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045bbcd-082d-4349-ab10-b9d43f306522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.403979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045bbcd-082d-4349-ab10-b9d43f306522 admin admin] PATH_INFO: `/v3/projects/784da3a056944da79e8d24fd0edc3200/users/aada1194b20b4adab0d6de6d7f2a0099/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.425062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:14.462278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045bbcd-082d-4349-ab10-b9d43f306522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784da3a056944da79e8d24fd0edc3200, user_id=aada1194b20b4adab0d6de6d7f2a0099, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.465038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045bbcd-082d-4349-ab10-b9d43f306522 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.618207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1101/2203] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:14 2022] PUT /identity/v3/projects/784da3a056944da79e8d24fd0edc3200/users/aada1194b20b4adab0d6de6d7f2a0099/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:14.620018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29021f3d-f5b2-46a7-a5e8-77b45a130ce0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.635630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29021f3d-f5b2-46a7-a5e8-77b45a130ce0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.823719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8d95d-800c-4fa1-b52f-a6c8aa1578b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.824359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8d95d-800c-4fa1-b52f-a6c8aa1578b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.824642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8d95d-800c-4fa1-b52f-a6c8aa1578b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.824911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8d95d-800c-4fa1-b52f-a6c8aa1578b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.825562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8d95d-800c-4fa1-b52f-a6c8aa1578b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.827391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8d95d-800c-4fa1-b52f-a6c8aa1578b2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.846697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1103/2204] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:14.850996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045bbcd-082d-4349-ab10-b9d43f306522 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:14.864868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045bbcd-082d-4349-ab10-b9d43f306522 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:14.879091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3a07-08ba-43c0-8f85-484492a9f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:14.879986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3a07-08ba-43c0-8f85-484492a9f5de admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.880353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3a07-08ba-43c0-8f85-484492a9f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.880763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3a07-08ba-43c0-8f85-484492a9f5de admin admin] PATH_INFO: `/v3/projects/784da3a056944da79e8d24fd0edc3200/users/aada1194b20b4adab0d6de6d7f2a0099/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.885479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b3a07-08ba-43c0-8f85-484492a9f5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=784da3a056944da79e8d24fd0edc3200, user_id=aada1194b20b4adab0d6de6d7f2a0099, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:14.906667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b3a07-08ba-43c0-8f85-484492a9f5de admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:14.936340 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1102/2205] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:14 2022] PUT /identity/v3/projects/784da3a056944da79e8d24fd0edc3200/users/aada1194b20b4adab0d6de6d7f2a0099/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:14.938072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b5a0-e54d-4522-857f-b1ae27df8f72 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:14.938395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b5a0-e54d-4522-857f-b1ae27df8f72 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:14.938664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b5a0-e54d-4522-857f-b1ae27df8f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:14.978844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e946b5a0-e54d-4522-857f-b1ae27df8f72 None None] MFA Rules not processed for user `aada1194b20b4adab0d6de6d7f2a0099`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:14.978844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e946b5a0-e54d-4522-857f-b1ae27df8f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:15.136815 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1104/2206] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:15.149733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3a07-08ba-43c0-8f85-484492a9f5de admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:15.151644 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1b2b3a07-08ba-43c0-8f85-484492a9f5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:15.276716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3a07-08ba-43c0-8f85-484492a9f5de admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:15.306968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451c420-c643-4ee1-8403-e9b14c81d57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:15.307618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451c420-c643-4ee1-8403-e9b14c81d57d service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:15.308099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451c420-c643-4ee1-8403-e9b14c81d57d service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:15.308375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451c420-c643-4ee1-8403-e9b14c81d57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:15.320303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451c420-c643-4ee1-8403-e9b14c81d57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:15.322277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451c420-c643-4ee1-8403-e9b14c81d57d service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:15.356790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1103/2207] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:15.786761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:16.051505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:17.232455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b5a0-e54d-4522-857f-b1ae27df8f72 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.251943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b5a0-e54d-4522-857f-b1ae27df8f72 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:17.257533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14b53-7914-4e35-891e-83bca24831d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:17.258988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14b53-7914-4e35-891e-83bca24831d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.259585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14b53-7914-4e35-891e-83bca24831d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.260089 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace14b53-7914-4e35-891e-83bca24831d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.338827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace14b53-7914-4e35-891e-83bca24831d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:17.341142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace14b53-7914-4e35-891e-83bca24831d9 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:17.369746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1105/2208] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:17.520940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f571-18ef-4bc9-b07c-f17efaa22495 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.521921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f571-18ef-4bc9-b07c-f17efaa22495 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.522346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f571-18ef-4bc9-b07c-f17efaa22495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.574283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d5c0f571-18ef-4bc9-b07c-f17efaa22495 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:17.576272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d5c0f571-18ef-4bc9-b07c-f17efaa22495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:17.711550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1104/2209] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:22:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:17.733991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14b53-7914-4e35-891e-83bca24831d9 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:17.741231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ace14b53-7914-4e35-891e-83bca24831d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:17.919405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace14b53-7914-4e35-891e-83bca24831d9 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:17.925826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b73c-d6be-4b7a-9d06-7494ee7621c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:17.926800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b73c-d6be-4b7a-9d06-7494ee7621c5 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:17.927097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b73c-d6be-4b7a-9d06-7494ee7621c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:17.927394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b73c-d6be-4b7a-9d06-7494ee7621c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:17.944894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577b73c-d6be-4b7a-9d06-7494ee7621c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:17.947446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577b73c-d6be-4b7a-9d06-7494ee7621c5 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:17.973534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1106/2210] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:22:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:22:18.664819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f571-18ef-4bc9-b07c-f17efaa22495 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:18.667084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d5c0f571-18ef-4bc9-b07c-f17efaa22495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:18.740970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f571-18ef-4bc9-b07c-f17efaa22495 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:18.746097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:18.746744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:18.747026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:18.747303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] PATH_INFO: `/v3/users/38913aea38dc41dc88304dad33d16171` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:18.751674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38913aea38dc41dc88304dad33d16171)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:18.751674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:18.881206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:18.964979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38913aea38dc41dc88304dad33d16171'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:18.965645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38913aea38dc41dc88304dad33d16171'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:19.028174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:19.056573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38913aea38dc41dc88304dad33d16171'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:19.059900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38913aea38dc41dc88304dad33d16171'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:19.070533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38913aea38dc41dc88304dad33d16171'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:19.087266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1105/2211] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:18 2022] DELETE /identity/v3/users/38913aea38dc41dc88304dad33d16171 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:19.088979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8dbd-c384-4324-b2e5-b6c00e3dc17a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:19.094384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8dbd-c384-4324-b2e5-b6c00e3dc17a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:19.094384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8dbd-c384-4324-b2e5-b6c00e3dc17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:19.112683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0b1a8dbd-c384-4324-b2e5-b6c00e3dc17a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:19.113916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0b1a8dbd-c384-4324-b2e5-b6c00e3dc17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:19.175083 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1107/2212] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:19.184951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:19.187151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:19.249442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4e7c-bc1e-412f-81c4-3b097481def7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:19.253391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f855d59-1086-407d-b8c0-b4c73ae57bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:19.254006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f855d59-1086-407d-b8c0-b4c73ae57bcf service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:19.254283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f855d59-1086-407d-b8c0-b4c73ae57bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:19.254558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f855d59-1086-407d-b8c0-b4c73ae57bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:19.264322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f855d59-1086-407d-b8c0-b4c73ae57bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:19.265755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f855d59-1086-407d-b8c0-b4c73ae57bcf service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:19.275262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1106/2213] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:19.783584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:19.790347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8dbd-c384-4324-b2e5-b6c00e3dc17a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:19.791766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0b1a8dbd-c384-4324-b2e5-b6c00e3dc17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:19.804992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8dbd-c384-4324-b2e5-b6c00e3dc17a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:19.810043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:19.811519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:19.811770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:19.812108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] PATH_INFO: `/v3/projects/07d0205d99b5428782f6a686504396f4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:19.813754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d0205d99b5428782f6a686504396f4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:19.815536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:19.945937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d0205d99b5428782f6a686504396f4', 'request_id': 'req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:19.952640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d0205d99b5428782f6a686504396f4', 'request_id': 'req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:20.051276 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d0205d99b5428782f6a686504396f4', 'request_id': 'req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:20.064370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] The token cache is being invalidate because project 07d0205d99b5428782f6a686504396f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:20.064658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:20.065333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:20.067000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1108/2214] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:19 2022] DELETE /identity/v3/projects/07d0205d99b5428782f6a686504396f4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:20.070940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f855d59-1086-407d-b8c0-b4c73ae57bcf service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:20.081017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f855d59-1086-407d-b8c0-b4c73ae57bcf service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:20.139215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:20.139925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:20.140204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:20.140473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] PATH_INFO: `/v3/users/0d9917718b33419394c1db600b8e2cc5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:20.141899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9917718b33419394c1db600b8e2cc5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:20.143920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:20.356891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9917718b33419394c1db600b8e2cc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:20.357596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9917718b33419394c1db600b8e2cc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:20.446111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9917718b33419394c1db600b8e2cc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:20.447472 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9917718b33419394c1db600b8e2cc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:20.462600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e4ba324-e6bc-4977-a837-bd251b80c469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9917718b33419394c1db600b8e2cc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:20.478026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1107/2215] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:20 2022] DELETE /identity/v3/users/0d9917718b33419394c1db600b8e2cc5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:20.583776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:21.004269 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:21.006281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:21.025844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae9e66-f7b5-46b9-80c9-fccd006d5706 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:21.109438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:21.111317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.111649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.111949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] PATH_INFO: `/v3/projects/f7cc7532472d49de9662c7aef0043a51` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.116940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cc7532472d49de9662c7aef0043a51)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:21.119026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:21.285482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cc7532472d49de9662c7aef0043a51', 'request_id': 'req-da504c6e-5d72-4936-bb3d-b345ea5eace2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:21.296144 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cc7532472d49de9662c7aef0043a51', 'request_id': 'req-da504c6e-5d72-4936-bb3d-b345ea5eace2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:21.401169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cc7532472d49de9662c7aef0043a51', 'request_id': 'req-da504c6e-5d72-4936-bb3d-b345ea5eace2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:21.414934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] The token cache is being invalidate because project f7cc7532472d49de9662c7aef0043a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:21.416056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:21.416812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-da504c6e-5d72-4936-bb3d-b345ea5eace2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:21.424557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1109/2216] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:21 2022] DELETE /identity/v3/projects/f7cc7532472d49de9662c7aef0043a51 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:21.426311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c02b-f074-404c-a991-bbe9a63b416f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.426752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c02b-f074-404c-a991-bbe9a63b416f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.426845 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c02b-f074-404c-a991-bbe9a63b416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.484214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ba61c02b-f074-404c-a991-bbe9a63b416f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:21.487726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ba61c02b-f074-404c-a991-bbe9a63b416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:21.566836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1108/2217] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:21.576980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1191a44-6378-45fd-8726-397cb1253ab7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.577396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1191a44-6378-45fd-8726-397cb1253ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.577743 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1191a44-6378-45fd-8726-397cb1253ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.600932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e1191a44-6378-45fd-8726-397cb1253ab7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:21.602154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e1191a44-6378-45fd-8726-397cb1253ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:21.613432 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1110/2218] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:21.617129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61c02b-f074-404c-a991-bbe9a63b416f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:21.630358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61c02b-f074-404c-a991-bbe9a63b416f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:21.635284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b940bb0-3ffc-43db-bd64-b0a710725d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:21.636123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b940bb0-3ffc-43db-bd64-b0a710725d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.636553 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b940bb0-3ffc-43db-bd64-b0a710725d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.637034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b940bb0-3ffc-43db-bd64-b0a710725d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.638030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b940bb0-3ffc-43db-bd64-b0a710725d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:21.638484 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b940bb0-3ffc-43db-bd64-b0a710725d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:21.641214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b940bb0-3ffc-43db-bd64-b0a710725d42 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:21.663537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1109/2219] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:21.668358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1191a44-6378-45fd-8726-397cb1253ab7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:21.680112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1191a44-6378-45fd-8726-397cb1253ab7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:21.685497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2546a-25ae-43aa-97b6-0aa1fc51aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:21.686541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2546a-25ae-43aa-97b6-0aa1fc51aebf admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.686926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2546a-25ae-43aa-97b6-0aa1fc51aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.687143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2546a-25ae-43aa-97b6-0aa1fc51aebf admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.689319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2546a-25ae-43aa-97b6-0aa1fc51aebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:21.690484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2546a-25ae-43aa-97b6-0aa1fc51aebf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:21.772108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:21.830425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1111/2220] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:21 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:21.834813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b940bb0-3ffc-43db-bd64-b0a710725d42 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:21.846261 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b940bb0-3ffc-43db-bd64-b0a710725d42 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:21.919262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bdd5d-82ab-4240-b8c9-924c928083e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:21.920284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bdd5d-82ab-4240-b8c9-924c928083e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:21.920773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bdd5d-82ab-4240-b8c9-924c928083e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:21.921273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bdd5d-82ab-4240-b8c9-924c928083e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:21.922458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bdd5d-82ab-4240-b8c9-924c928083e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:21.926363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bdd5d-82ab-4240-b8c9-924c928083e7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.156401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1110/2221] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:21 2022] POST /identity/v3/users => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:22.160660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2546a-25ae-43aa-97b6-0aa1fc51aebf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.177111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2546a-25ae-43aa-97b6-0aa1fc51aebf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.208544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ef4c7-ade4-4740-84e4-808b020be747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.208544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ef4c7-ade4-4740-84e4-808b020be747 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.208544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ef4c7-ade4-4740-84e4-808b020be747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.208544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ef4c7-ade4-4740-84e4-808b020be747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.208938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ef4c7-ade4-4740-84e4-808b020be747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.209951 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ef4c7-ade4-4740-84e4-808b020be747 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.227166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1112/2222] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:22.228971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bdd5d-82ab-4240-b8c9-924c928083e7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.249394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bdd5d-82ab-4240-b8c9-924c928083e7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.257296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d9f94-18da-4804-a4f2-64cb9882897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.258240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d9f94-18da-4804-a4f2-64cb9882897b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.258528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d9f94-18da-4804-a4f2-64cb9882897b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.258808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d9f94-18da-4804-a4f2-64cb9882897b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.259627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d9f94-18da-4804-a4f2-64cb9882897b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.261594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d9f94-18da-4804-a4f2-64cb9882897b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.281242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1111/2223] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:22.285957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ef4c7-ade4-4740-84e4-808b020be747 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.314984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ef4c7-ade4-4740-84e4-808b020be747 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.320151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96a6aa-29af-48a9-916c-05d051456137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.320835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96a6aa-29af-48a9-916c-05d051456137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.321110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96a6aa-29af-48a9-916c-05d051456137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.321508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96a6aa-29af-48a9-916c-05d051456137 admin admin] PATH_INFO: `/v3/projects/3380e9c118434373a8b828e8038feeb2/users/5c09cfeceb7c41f58c7c416dcbf58ac0/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.363210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96a6aa-29af-48a9-916c-05d051456137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3380e9c118434373a8b828e8038feeb2, user_id=5c09cfeceb7c41f58c7c416dcbf58ac0, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.366437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96a6aa-29af-48a9-916c-05d051456137 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.382445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d9f94-18da-4804-a4f2-64cb9882897b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.384464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bb4d9f94-18da-4804-a4f2-64cb9882897b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:22.396349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:22.406756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d9f94-18da-4804-a4f2-64cb9882897b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.415103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.426980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.427625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.427625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] PATH_INFO: `/v3/users/45a512d2e2f646608c2fdb5b44dfc2b9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.432257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a512d2e2f646608c2fdb5b44dfc2b9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.438522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.464120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1113/2224] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:22 2022] PUT /identity/v3/projects/3380e9c118434373a8b828e8038feeb2/users/5c09cfeceb7c41f58c7c416dcbf58ac0/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:22.478607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c96b-1669-4c2b-9cb4-fcaf52bc00de None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.479727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c96b-1669-4c2b-9cb4-fcaf52bc00de None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.480174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c96b-1669-4c2b-9cb4-fcaf52bc00de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.545682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2687c96b-1669-4c2b-9cb4-fcaf52bc00de None None] MFA Rules not processed for user `5c09cfeceb7c41f58c7c416dcbf58ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:22.548209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2687c96b-1669-4c2b-9cb4-fcaf52bc00de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:22.648401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1114/2225] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:22.656413 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687c96b-1669-4c2b-9cb4-fcaf52bc00de None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:22.684132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:22.765995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a512d2e2f646608c2fdb5b44dfc2b9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:22.769162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a512d2e2f646608c2fdb5b44dfc2b9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:22.795797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687c96b-1669-4c2b-9cb4-fcaf52bc00de None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:22.803801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde515fc-39ad-43c2-a147-e821930e414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:22.804433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde515fc-39ad-43c2-a147-e821930e414a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.804727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde515fc-39ad-43c2-a147-e821930e414a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.815618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde515fc-39ad-43c2-a147-e821930e414a admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.815618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde515fc-39ad-43c2-a147-e821930e414a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:22.817883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde515fc-39ad-43c2-a147-e821930e414a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:22.835503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a512d2e2f646608c2fdb5b44dfc2b9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:22.836312 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a512d2e2f646608c2fdb5b44dfc2b9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:22.857495 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4ae58fb3-77f9-48d5-858c-a07fcd4fd33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a512d2e2f646608c2fdb5b44dfc2b9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:22.875587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1112/2226] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:22 2022] DELETE /identity/v3/users/45a512d2e2f646608c2fdb5b44dfc2b9 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:22.877071 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afba2d-9430-43ec-a64f-bbb327952d79 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:22.877416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afba2d-9430-43ec-a64f-bbb327952d79 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:22.877695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afba2d-9430-43ec-a64f-bbb327952d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:22.902861 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c7afba2d-9430-43ec-a64f-bbb327952d79 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:22.905462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c7afba2d-9430-43ec-a64f-bbb327952d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:22.992291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1115/2227] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:22 2022] POST /identity/v3/projects => generated 401 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:22.993280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde515fc-39ad-43c2-a147-e821930e414a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.001519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fde515fc-39ad-43c2-a147-e821930e414a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:23.056313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1113/2228] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:23.069316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afba2d-9430-43ec-a64f-bbb327952d79 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:23.071009 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c7afba2d-9430-43ec-a64f-bbb327952d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:23.247828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde515fc-39ad-43c2-a147-e821930e414a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.250501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afba2d-9430-43ec-a64f-bbb327952d79 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:23.251038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3da7d-7967-431f-8a3f-8ddc004f4fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.251038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3da7d-7967-431f-8a3f-8ddc004f4fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.251038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3da7d-7967-431f-8a3f-8ddc004f4fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.251038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3da7d-7967-431f-8a3f-8ddc004f4fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.251619 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3da7d-7967-431f-8a3f-8ddc004f4fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.251619 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3da7d-7967-431f-8a3f-8ddc004f4fd0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.259788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9832024-ebab-4d99-970c-6e1812f9e71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:23.260476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9832024-ebab-4d99-970c-6e1812f9e71c service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:23.260757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9832024-ebab-4d99-970c-6e1812f9e71c service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:23.261050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9832024-ebab-4d99-970c-6e1812f9e71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:23.281273 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9832024-ebab-4d99-970c-6e1812f9e71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:23.282897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9832024-ebab-4d99-970c-6e1812f9e71c service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:23.297659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1114/2229] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:24.079520 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9832024-ebab-4d99-970c-6e1812f9e71c service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.087059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1116/2230] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:22 2022] POST /identity/v3/users => generated 307 bytes in 1094 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:24.092353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9832024-ebab-4d99-970c-6e1812f9e71c service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.098717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383234c5-3fe7-4740-8198-78bb04d9b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.099476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383234c5-3fe7-4740-8198-78bb04d9b841 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.099779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383234c5-3fe7-4740-8198-78bb04d9b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.100051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383234c5-3fe7-4740-8198-78bb04d9b841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.100698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383234c5-3fe7-4740-8198-78bb04d9b841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.102701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383234c5-3fe7-4740-8198-78bb04d9b841 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.130147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1115/2231] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:24.131553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3da7d-7967-431f-8a3f-8ddc004f4fd0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.147204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3da7d-7967-431f-8a3f-8ddc004f4fd0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.158394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498b5f1-d0d4-476b-80fb-774b5956ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.158394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498b5f1-d0d4-476b-80fb-774b5956ffd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.158394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498b5f1-d0d4-476b-80fb-774b5956ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.158883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498b5f1-d0d4-476b-80fb-774b5956ffd7 admin admin] PATH_INFO: `/v3/projects/63be94cd7ffe4268a6811b103c621350/users/6013b8456f554b578bd980b998d2feb4/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.186978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498b5f1-d0d4-476b-80fb-774b5956ffd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63be94cd7ffe4268a6811b103c621350, user_id=6013b8456f554b578bd980b998d2feb4, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.190544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498b5f1-d0d4-476b-80fb-774b5956ffd7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.302262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1117/2232] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:24 2022] PUT /identity/v3/projects/63be94cd7ffe4268a6811b103c621350/users/6013b8456f554b578bd980b998d2feb4/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:24.308972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383234c5-3fe7-4740-8198-78bb04d9b841 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.325107 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383234c5-3fe7-4740-8198-78bb04d9b841 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.439654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5f92f-89b4-4dd9-8a8f-71a7efd5b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.440774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5f92f-89b4-4dd9-8a8f-71a7efd5b878 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.441286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5f92f-89b4-4dd9-8a8f-71a7efd5b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.447654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5f92f-89b4-4dd9-8a8f-71a7efd5b878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.451639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5f92f-89b4-4dd9-8a8f-71a7efd5b878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.453809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5f92f-89b4-4dd9-8a8f-71a7efd5b878 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.481806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1116/2233] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:24.482026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498b5f1-d0d4-476b-80fb-774b5956ffd7 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.493510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498b5f1-d0d4-476b-80fb-774b5956ffd7 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.500547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aeb28-b1e4-4e7d-a19f-a8ca7865aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.501394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aeb28-b1e4-4e7d-a19f-a8ca7865aa6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.501917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aeb28-b1e4-4e7d-a19f-a8ca7865aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.502426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7aeb28-b1e4-4e7d-a19f-a8ca7865aa6e admin admin] PATH_INFO: `/v3/projects/63be94cd7ffe4268a6811b103c621350/users/6013b8456f554b578bd980b998d2feb4/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.504981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7aeb28-b1e4-4e7d-a19f-a8ca7865aa6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63be94cd7ffe4268a6811b103c621350, user_id=6013b8456f554b578bd980b998d2feb4, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.510567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7aeb28-b1e4-4e7d-a19f-a8ca7865aa6e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.538961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1118/2234] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:24 2022] PUT /identity/v3/projects/63be94cd7ffe4268a6811b103c621350/users/6013b8456f554b578bd980b998d2feb4/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:24.542739 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ccf7-4a12-4536-b926-5920174ea196 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.543037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ccf7-4a12-4536-b926-5920174ea196 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.543434 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63ccf7-4a12-4536-b926-5920174ea196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.602252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4c63ccf7-4a12-4536-b926-5920174ea196 None None] MFA Rules not processed for user `6013b8456f554b578bd980b998d2feb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:24.618740 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4c63ccf7-4a12-4536-b926-5920174ea196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:24.619580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aeb28-b1e4-4e7d-a19f-a8ca7865aa6e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.624666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ee7aeb28-b1e4-4e7d-a19f-a8ca7865aa6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:24.781169 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7aeb28-b1e4-4e7d-a19f-a8ca7865aa6e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:24.796348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:24.797148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:24.797647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:24.798125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] PATH_INFO: `/v3/projects/e071dee89f604c6d8983e3e5dd0db2b4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:24.801406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e071dee89f604c6d8983e3e5dd0db2b4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:24.803579 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:24.910075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1117/2235] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:24 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:24.917376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63ccf7-4a12-4536-b926-5920174ea196 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:24.919600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4c63ccf7-4a12-4536-b926-5920174ea196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:24.963139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e071dee89f604c6d8983e3e5dd0db2b4', 'request_id': 'req-d2ab7f5e-6515-4150-a119-9a12e90e527f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:25.006599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e071dee89f604c6d8983e3e5dd0db2b4', 'request_id': 'req-d2ab7f5e-6515-4150-a119-9a12e90e527f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:25.021693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63ccf7-4a12-4536-b926-5920174ea196 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.105058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7af66-a18e-4fd6-ba78-62a01da7e3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.105824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7af66-a18e-4fd6-ba78-62a01da7e3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.105941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7af66-a18e-4fd6-ba78-62a01da7e3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.106188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7af66-a18e-4fd6-ba78-62a01da7e3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.178988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e071dee89f604c6d8983e3e5dd0db2b4', 'request_id': 'req-d2ab7f5e-6515-4150-a119-9a12e90e527f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:25.203495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] The token cache is being invalidate because project e071dee89f604c6d8983e3e5dd0db2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:25.204061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:25.204899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2ab7f5e-6515-4150-a119-9a12e90e527f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:25.207406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1119/2236] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:24 2022] DELETE /identity/v3/projects/e071dee89f604c6d8983e3e5dd0db2b4 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:25.213283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7af66-a18e-4fd6-ba78-62a01da7e3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.220049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280f69-9b88-458e-b15b-be7f55f1618e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.220049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280f69-9b88-458e-b15b-be7f55f1618e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.220049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0280f69-9b88-458e-b15b-be7f55f1618e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.220454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7af66-a18e-4fd6-ba78-62a01da7e3a8 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.227392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1118/2237] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:24 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:25.237523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c0280f69-9b88-458e-b15b-be7f55f1618e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:25.239024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c0280f69-9b88-458e-b15b-be7f55f1618e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:25.349650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:25.352119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1120/2238] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:25.362849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44be122-acf7-43be-9a50-3a30395ea867 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.363205 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44be122-acf7-43be-9a50-3a30395ea867 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.363568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44be122-acf7-43be-9a50-3a30395ea867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.388807 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b44be122-acf7-43be-9a50-3a30395ea867 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:25.392691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b44be122-acf7-43be-9a50-3a30395ea867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:25.422064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1119/2239] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:25.426134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0280f69-9b88-458e-b15b-be7f55f1618e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:25.444719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0280f69-9b88-458e-b15b-be7f55f1618e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.454263 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.455048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.455395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.455806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.456553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:25.456999 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.459332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.486378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1121/2240] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:25.491243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44be122-acf7-43be-9a50-3a30395ea867 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:25.521347 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44be122-acf7-43be-9a50-3a30395ea867 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.521892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:25.531828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:25.534220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:25.542433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dad60-aaf8-41f1-8092-24acc477ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.543322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dad60-aaf8-41f1-8092-24acc477ad72 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.543322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dad60-aaf8-41f1-8092-24acc477ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.544161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dad60-aaf8-41f1-8092-24acc477ad72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.544812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dad60-aaf8-41f1-8092-24acc477ad72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.547251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dad60-aaf8-41f1-8092-24acc477ad72 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.566270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee9b3-9b52-437a-b675-e437a8a10bf2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.570474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647988a-458b-4059-b694-26ae13062419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.571097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647988a-458b-4059-b694-26ae13062419 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.571488 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647988a-458b-4059-b694-26ae13062419 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.571639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647988a-458b-4059-b694-26ae13062419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.573570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5647988a-458b-4059-b694-26ae13062419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:25.664010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647988a-458b-4059-b694-26ae13062419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.665570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647988a-458b-4059-b694-26ae13062419 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.701824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1122/2241] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:25 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:25.702962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1120/2242] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:25 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:25.707339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647988a-458b-4059-b694-26ae13062419 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:25.721377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647988a-458b-4059-b694-26ae13062419 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.731796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dad60-aaf8-41f1-8092-24acc477ad72 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:25.734986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-463dad60-aaf8-41f1-8092-24acc477ad72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:25.813617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce275cea-7440-4830-be6f-1042d245b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.815805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce275cea-7440-4830-be6f-1042d245b81a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.816763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce275cea-7440-4830-be6f-1042d245b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.818416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce275cea-7440-4830-be6f-1042d245b81a admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.819385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce275cea-7440-4830-be6f-1042d245b81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.821900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce275cea-7440-4830-be6f-1042d245b81a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.824946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dad60-aaf8-41f1-8092-24acc477ad72 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.829650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521643e-1c8a-4687-9a1d-da0cb2a92cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.830596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521643e-1c8a-4687-9a1d-da0cb2a92cab service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.831097 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521643e-1c8a-4687-9a1d-da0cb2a92cab service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.831631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521643e-1c8a-4687-9a1d-da0cb2a92cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.833933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6521643e-1c8a-4687-9a1d-da0cb2a92cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:25.917342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521643e-1c8a-4687-9a1d-da0cb2a92cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.919152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521643e-1c8a-4687-9a1d-da0cb2a92cab service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.939934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1123/2243] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:25 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:25.941982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce275cea-7440-4830-be6f-1042d245b81a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:25.949127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1121/2244] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:25.954821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce275cea-7440-4830-be6f-1042d245b81a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:25.961966 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b86ad-93c3-4c3d-a62a-6cd145170141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:25.963092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b86ad-93c3-4c3d-a62a-6cd145170141 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:25.963610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b86ad-93c3-4c3d-a62a-6cd145170141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:25.964206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b86ad-93c3-4c3d-a62a-6cd145170141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:25.965321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b86ad-93c3-4c3d-a62a-6cd145170141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:25.973885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b86ad-93c3-4c3d-a62a-6cd145170141 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:25.995801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1124/2245] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:25.999635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521643e-1c8a-4687-9a1d-da0cb2a92cab service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:26.017196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521643e-1c8a-4687-9a1d-da0cb2a92cab service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:26.031657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84b70c-f3be-4b4e-824f-c0075f40e2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:26.032338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84b70c-f3be-4b4e-824f-c0075f40e2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.032804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84b70c-f3be-4b4e-824f-c0075f40e2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.034081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84b70c-f3be-4b4e-824f-c0075f40e2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.034750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84b70c-f3be-4b4e-824f-c0075f40e2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:26.042303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84b70c-f3be-4b4e-824f-c0075f40e2b1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:26.062215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1122/2246] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:26.066534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b86ad-93c3-4c3d-a62a-6cd145170141 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:26.081533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b86ad-93c3-4c3d-a62a-6cd145170141 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:26.096076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3769a-b896-4f7b-a120-628d595a67c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:26.097067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3769a-b896-4f7b-a120-628d595a67c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.097452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3769a-b896-4f7b-a120-628d595a67c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.097830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3769a-b896-4f7b-a120-628d595a67c4 admin admin] PATH_INFO: `/v3/projects/c4d29173030848c2a3407492e07d2147/users/db97ff2985a146c2852832c07979a152/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.119416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3769a-b896-4f7b-a120-628d595a67c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d29173030848c2a3407492e07d2147, user_id=db97ff2985a146c2852832c07979a152, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:26.124917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3769a-b896-4f7b-a120-628d595a67c4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:26.350436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1125/2247] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:26 2022] PUT /identity/v3/projects/c4d29173030848c2a3407492e07d2147/users/db97ff2985a146c2852832c07979a152/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:26.358910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d153a-c7f0-4c33-aaef-3eb786dc946f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.370558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d153a-c7f0-4c33-aaef-3eb786dc946f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.370558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d153a-c7f0-4c33-aaef-3eb786dc946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.399482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-877d153a-c7f0-4c33-aaef-3eb786dc946f None None] MFA Rules not processed for user `db97ff2985a146c2852832c07979a152`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:26.400702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-877d153a-c7f0-4c33-aaef-3eb786dc946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:26.516129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1123/2248] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:26.795826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3769a-b896-4f7b-a120-628d595a67c4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:26.875095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3769a-b896-4f7b-a120-628d595a67c4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:26.879311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ecfdf-7514-417d-a37c-70d7ca915d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:26.880073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ecfdf-7514-417d-a37c-70d7ca915d22 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:26.880519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ecfdf-7514-417d-a37c-70d7ca915d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:26.880751 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ecfdf-7514-417d-a37c-70d7ca915d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:26.895119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ecfdf-7514-417d-a37c-70d7ca915d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:26.897817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ecfdf-7514-417d-a37c-70d7ca915d22 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:26.915885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1126/2249] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:28.835377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:29.160616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:29.979066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:31.263696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d153a-c7f0-4c33-aaef-3eb786dc946f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:31.265554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-877d153a-c7f0-4c33-aaef-3eb786dc946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:31.333494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d153a-c7f0-4c33-aaef-3eb786dc946f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:31.338026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:31.338662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:31.338934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:31.339230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] PATH_INFO: `/v3/users/2c7a6b991c4b42e58b493b631a382149` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:31.340410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7a6b991c4b42e58b493b631a382149)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:31.342307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:31.560443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7a6b991c4b42e58b493b631a382149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:31.561114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7a6b991c4b42e58b493b631a382149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:31.633611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7a6b991c4b42e58b493b631a382149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:31.634267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7a6b991c4b42e58b493b631a382149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:31.647040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7a6b991c4b42e58b493b631a382149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:31.659720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1124/2250] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:31 2022] DELETE /identity/v3/users/2c7a6b991c4b42e58b493b631a382149 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:31.664144 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae3112-cf41-4080-acea-9abc4d0f323c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:31.664614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae3112-cf41-4080-acea-9abc4d0f323c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:31.664705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae3112-cf41-4080-acea-9abc4d0f323c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:31.684191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-84ae3112-cf41-4080-acea-9abc4d0f323c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:31.685387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-84ae3112-cf41-4080-acea-9abc4d0f323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:31.756934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1127/2251] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:31.763477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:31.765537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:31.826590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be8445-5a96-45e7-a580-11ae3f7b3346 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:31.830818 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8ad6f-3bcb-4a3d-a930-1569512371f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:31.831418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8ad6f-3bcb-4a3d-a930-1569512371f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:31.831694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8ad6f-3bcb-4a3d-a930-1569512371f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:31.831999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8ad6f-3bcb-4a3d-a930-1569512371f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:31.841049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8ad6f-3bcb-4a3d-a930-1569512371f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:31.842481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8ad6f-3bcb-4a3d-a930-1569512371f5 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:31.852404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1125/2252] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:31.879425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:32.194203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:32.428787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae3112-cf41-4080-acea-9abc4d0f323c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:32.430292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-84ae3112-cf41-4080-acea-9abc4d0f323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:32.443003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae3112-cf41-4080-acea-9abc4d0f323c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.450283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.450283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.450283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.450283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] PATH_INFO: `/v3/users/5c09cfeceb7c41f58c7c416dcbf58ac0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.450639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c09cfeceb7c41f58c7c416dcbf58ac0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.455076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.567449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8ad6f-3bcb-4a3d-a930-1569512371f5 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:32.568942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-80c8ad6f-3bcb-4a3d-a930-1569512371f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:32.572500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:32.587894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8ad6f-3bcb-4a3d-a930-1569512371f5 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.595213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.596416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.596873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.597176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] PATH_INFO: `/v3/projects/3eeb7d6efcb949f0a7c36ba2f091fb61` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.598585 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eeb7d6efcb949f0a7c36ba2f091fb61)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.600594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.681667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c09cfeceb7c41f58c7c416dcbf58ac0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.713334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eeb7d6efcb949f0a7c36ba2f091fb61', 'request_id': 'req-0f58c902-8a05-4fe4-b38c-6c6fcb416015'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.714706 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c09cfeceb7c41f58c7c416dcbf58ac0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.721485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eeb7d6efcb949f0a7c36ba2f091fb61', 'request_id': 'req-0f58c902-8a05-4fe4-b38c-6c6fcb416015'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.728575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eeb7d6efcb949f0a7c36ba2f091fb61', 'request_id': 'req-0f58c902-8a05-4fe4-b38c-6c6fcb416015'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.730320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c09cfeceb7c41f58c7c416dcbf58ac0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.731148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c09cfeceb7c41f58c7c416dcbf58ac0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.731936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7d9245f1-b309-4864-a1a9-bf30a68b1156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c09cfeceb7c41f58c7c416dcbf58ac0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.795168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] The token cache is being invalidate because project 3eeb7d6efcb949f0a7c36ba2f091fb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:32.800461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.800461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:32.800461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1126/2253] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:32 2022] DELETE /identity/v3/projects/3eeb7d6efcb949f0a7c36ba2f091fb61 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:32.803061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:32.804341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:32.872353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c902-8a05-4fe4-b38c-6c6fcb416015 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:32.878105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:32.878674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.878934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.879218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] PATH_INFO: `/v3/users/1cf99f243a4a4f62a18914d922850a41` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.880490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf99f243a4a4f62a18914d922850a41)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:32.882461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:32.932340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1128/2254] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:32 2022] DELETE /identity/v3/users/5c09cfeceb7c41f58c7c416dcbf58ac0 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:32.937093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cfab3-e77b-493e-9ec3-b2c7b7741bc9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:32.937459 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cfab3-e77b-493e-9ec3-b2c7b7741bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:32.937736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cfab3-e77b-493e-9ec3-b2c7b7741bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:32.957428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-039cfab3-e77b-493e-9ec3-b2c7b7741bc9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:32.958753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-039cfab3-e77b-493e-9ec3-b2c7b7741bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:33.018391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1129/2255] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:33.028718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cfab3-e77b-493e-9ec3-b2c7b7741bc9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:33.030048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-039cfab3-e77b-493e-9ec3-b2c7b7741bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:33.086406 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cfab3-e77b-493e-9ec3-b2c7b7741bc9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:33.090048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6eaa6-860a-40f2-af10-f079a5d912ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:33.090642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6eaa6-860a-40f2-af10-f079a5d912ad service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:33.090918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6eaa6-860a-40f2-af10-f079a5d912ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:33.091189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6eaa6-860a-40f2-af10-f079a5d912ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:33.100054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6eaa6-860a-40f2-af10-f079a5d912ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:33.101473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6eaa6-860a-40f2-af10-f079a5d912ad service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:33.111212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1130/2256] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:33.190290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:33.205065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf99f243a4a4f62a18914d922850a41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:33.205798 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf99f243a4a4f62a18914d922850a41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:33.336296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf99f243a4a4f62a18914d922850a41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:33.336909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf99f243a4a4f62a18914d922850a41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:33.350324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf99f243a4a4f62a18914d922850a41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:33.363461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1127/2257] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:32 2022] DELETE /identity/v3/users/1cf99f243a4a4f62a18914d922850a41 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:33.456601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:33.769186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6eaa6-860a-40f2-af10-f079a5d912ad service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:33.771429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-abf6eaa6-860a-40f2-af10-f079a5d912ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:33.786565 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6eaa6-860a-40f2-af10-f079a5d912ad service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:33.879845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:33.880985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:33.881445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:33.881984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] PATH_INFO: `/v3/projects/3380e9c118434373a8b828e8038feeb2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:33.883530 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3380e9c118434373a8b828e8038feeb2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:33.885782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:34.027492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:34.030053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:34.048982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3380e9c118434373a8b828e8038feeb2', 'request_id': 'req-b07744bd-05ac-40f7-85cd-32c23aec4d24'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.052750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4c5c7-0fdc-4e23-933a-7a5107dbaf9b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:34.063326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3380e9c118434373a8b828e8038feeb2', 'request_id': 'req-b07744bd-05ac-40f7-85cd-32c23aec4d24'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.138112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:34.138867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:34.139236 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:34.140291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] PATH_INFO: `/v3/projects/6590f70a3a4b48eb90b28887376b701a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:34.141970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6590f70a3a4b48eb90b28887376b701a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:34.144016 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:34.324574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3380e9c118434373a8b828e8038feeb2', 'request_id': 'req-b07744bd-05ac-40f7-85cd-32c23aec4d24'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.357387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] The token cache is being invalidate because project 3380e9c118434373a8b828e8038feeb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:34.357816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.364214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.364364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6590f70a3a4b48eb90b28887376b701a', 'request_id': 'req-ad63ef75-5207-4569-a7f4-0b35c054cb63'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.365341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1131/2258] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:33 2022] DELETE /identity/v3/projects/3380e9c118434373a8b828e8038feeb2 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:34.369580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:34.371713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:34.387330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6590f70a3a4b48eb90b28887376b701a', 'request_id': 'req-ad63ef75-5207-4569-a7f4-0b35c054cb63'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.388981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07744bd-05ac-40f7-85cd-32c23aec4d24 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:34.407497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6590f70a3a4b48eb90b28887376b701a', 'request_id': 'req-ad63ef75-5207-4569-a7f4-0b35c054cb63'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.485243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:34.485441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:34.485593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:34.485871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] PATH_INFO: `/v3/users/6013b8456f554b578bd980b998d2feb4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:34.487181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6013b8456f554b578bd980b998d2feb4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:34.489971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:34.509791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] The token cache is being invalidate because project 6590f70a3a4b48eb90b28887376b701a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:34.512973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.515324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.519091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1128/2259] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:34 2022] DELETE /identity/v3/projects/6590f70a3a4b48eb90b28887376b701a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:34.522713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:34.527924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:34.549676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63ef75-5207-4569-a7f4-0b35c054cb63 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:34.558000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:34.558795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:34.559145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:34.559488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] PATH_INFO: `/v3/users/aada1194b20b4adab0d6de6d7f2a0099` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:34.561418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aada1194b20b4adab0d6de6d7f2a0099)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:34.564282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:34.653983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:34.670234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6013b8456f554b578bd980b998d2feb4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.681505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6013b8456f554b578bd980b998d2feb4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.696386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6013b8456f554b578bd980b998d2feb4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.697437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6013b8456f554b578bd980b998d2feb4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.698458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6013b8456f554b578bd980b998d2feb4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.791047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1132/2260] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:34 2022] DELETE /identity/v3/users/6013b8456f554b578bd980b998d2feb4 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:34.826972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aada1194b20b4adab0d6de6d7f2a0099'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.828612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aada1194b20b4adab0d6de6d7f2a0099'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.932819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aada1194b20b4adab0d6de6d7f2a0099'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.933814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aada1194b20b4adab0d6de6d7f2a0099'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.948911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-00bedb9a-fcfd-4afb-922d-ab17ef83df72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aada1194b20b4adab0d6de6d7f2a0099'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:34.965129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1129/2261] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:34 2022] DELETE /identity/v3/users/aada1194b20b4adab0d6de6d7f2a0099 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:35.241541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:35.689286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:35.690783 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:35.813744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aaffb-5ed2-411a-8bb5-eeb16a705918 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:35.897313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:35.898443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:35.898909 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:35.899352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] PATH_INFO: `/v3/projects/63be94cd7ffe4268a6811b103c621350` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:35.900729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63be94cd7ffe4268a6811b103c621350)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:35.902869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:36.053896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63be94cd7ffe4268a6811b103c621350', 'request_id': 'req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:36.060171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63be94cd7ffe4268a6811b103c621350', 'request_id': 'req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:36.148850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63be94cd7ffe4268a6811b103c621350', 'request_id': 'req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:36.164468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] The token cache is being invalidate because project 63be94cd7ffe4268a6811b103c621350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:36.164768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:36.165994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ab3ce4e7-e475-4ef6-80d0-3aa36181367a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:36.168043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1133/2262] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:35 2022] DELETE /identity/v3/projects/63be94cd7ffe4268a6811b103c621350 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:36.173128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639f3e3-0503-4fee-8d38-34976fb00e43 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.173417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639f3e3-0503-4fee-8d38-34976fb00e43 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.173696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639f3e3-0503-4fee-8d38-34976fb00e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.203424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9639f3e3-0503-4fee-8d38-34976fb00e43 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:36.206010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9639f3e3-0503-4fee-8d38-34976fb00e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:36.317364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1130/2263] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:36.317967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc61bb9-a332-4b89-be97-3d9a5da09b4e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.317967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc61bb9-a332-4b89-be97-3d9a5da09b4e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.317967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc61bb9-a332-4b89-be97-3d9a5da09b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.348450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5dc61bb9-a332-4b89-be97-3d9a5da09b4e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:36.350786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5dc61bb9-a332-4b89-be97-3d9a5da09b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:36.370495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:36.382203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1134/2264] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:36.383645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639f3e3-0503-4fee-8d38-34976fb00e43 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:36.398953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639f3e3-0503-4fee-8d38-34976fb00e43 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:36.405259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157acaa-a0f9-4cd0-9284-b3e39ea3b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:36.405868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157acaa-a0f9-4cd0-9284-b3e39ea3b2ec admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.406325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157acaa-a0f9-4cd0-9284-b3e39ea3b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.406657 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157acaa-a0f9-4cd0-9284-b3e39ea3b2ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.407362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157acaa-a0f9-4cd0-9284-b3e39ea3b2ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:36.407538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157acaa-a0f9-4cd0-9284-b3e39ea3b2ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:36.410017 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157acaa-a0f9-4cd0-9284-b3e39ea3b2ec admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:36.428023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1131/2265] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:36.432869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc61bb9-a332-4b89-be97-3d9a5da09b4e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:36.444661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc61bb9-a332-4b89-be97-3d9a5da09b4e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:36.455175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37876d-915d-45ec-9875-c08b44b7543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:36.455855 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37876d-915d-45ec-9875-c08b44b7543d admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.456197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37876d-915d-45ec-9875-c08b44b7543d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.456495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37876d-915d-45ec-9875-c08b44b7543d admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.457342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37876d-915d-45ec-9875-c08b44b7543d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:36.459877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37876d-915d-45ec-9875-c08b44b7543d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:36.590914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1135/2266] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:36 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:36.593772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157acaa-a0f9-4cd0-9284-b3e39ea3b2ec admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:36.619421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37876d-915d-45ec-9875-c08b44b7543d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:36.627219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ff37876d-915d-45ec-9875-c08b44b7543d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:36.630821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157acaa-a0f9-4cd0-9284-b3e39ea3b2ec admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:36.790934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db80b8-8007-45ed-a995-02285febce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:36.791509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db80b8-8007-45ed-a995-02285febce70 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.791819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db80b8-8007-45ed-a995-02285febce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.792658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db80b8-8007-45ed-a995-02285febce70 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.797105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db80b8-8007-45ed-a995-02285febce70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:36.800233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db80b8-8007-45ed-a995-02285febce70 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:36.803648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37876d-915d-45ec-9875-c08b44b7543d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:36.820523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:36.821164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:36.821456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:36.821736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] PATH_INFO: `/v3/projects/784da3a056944da79e8d24fd0edc3200` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:36.822966 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=784da3a056944da79e8d24fd0edc3200)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:36.825567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:36.916876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1132/2267] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:36 2022] POST /identity/v3/users => generated 294 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:36.921293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db80b8-8007-45ed-a995-02285febce70 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:36.934750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db80b8-8007-45ed-a995-02285febce70 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:36.967368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784da3a056944da79e8d24fd0edc3200', 'request_id': 'req-991fe5b0-fe32-45b5-94d2-62287d0fab1f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:36.979553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784da3a056944da79e8d24fd0edc3200', 'request_id': 'req-991fe5b0-fe32-45b5-94d2-62287d0fab1f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:37.033453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2890b-1148-40de-89bc-206a1ba33a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.034105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2890b-1148-40de-89bc-206a1ba33a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.034385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2890b-1148-40de-89bc-206a1ba33a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.035133 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2890b-1148-40de-89bc-206a1ba33a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.035316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2890b-1148-40de-89bc-206a1ba33a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.036967 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2890b-1148-40de-89bc-206a1ba33a3a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.052938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1133/2268] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:37.062595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2890b-1148-40de-89bc-206a1ba33a3a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.086286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2890b-1148-40de-89bc-206a1ba33a3a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.101822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6b531-2c9e-4e8e-93cb-7f6bcb1eb189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.102459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6b531-2c9e-4e8e-93cb-7f6bcb1eb189 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.102877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6b531-2c9e-4e8e-93cb-7f6bcb1eb189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.103146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6b531-2c9e-4e8e-93cb-7f6bcb1eb189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.103826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6b531-2c9e-4e8e-93cb-7f6bcb1eb189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.105423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6b531-2c9e-4e8e-93cb-7f6bcb1eb189 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.117511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1134/2269] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:37.121584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6b531-2c9e-4e8e-93cb-7f6bcb1eb189 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.132300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6b531-2c9e-4e8e-93cb-7f6bcb1eb189 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.136962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b9c4d-2eff-485a-9fb8-337b447d2a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.137603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b9c4d-2eff-485a-9fb8-337b447d2a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.137896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b9c4d-2eff-485a-9fb8-337b447d2a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.138151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b9c4d-2eff-485a-9fb8-337b447d2a73 admin admin] PATH_INFO: `/v3/projects/d58459e314e046bf90526ae51ae07cb2/users/8b0a0c746e624a4ebe8261af6c7b2a42/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.141991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784da3a056944da79e8d24fd0edc3200', 'request_id': 'req-991fe5b0-fe32-45b5-94d2-62287d0fab1f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:37.150755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] The token cache is being invalidate because project 784da3a056944da79e8d24fd0edc3200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:37.151111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:37.152092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-991fe5b0-fe32-45b5-94d2-62287d0fab1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:37.153452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b9c4d-2eff-485a-9fb8-337b447d2a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58459e314e046bf90526ae51ae07cb2, user_id=8b0a0c746e624a4ebe8261af6c7b2a42, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.153829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1136/2270] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:36 2022] DELETE /identity/v3/projects/784da3a056944da79e8d24fd0edc3200 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:37.158667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b9c4d-2eff-485a-9fb8-337b447d2a73 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.159855 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8d72-57cf-471e-8b78-29e42ad67e48 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.165107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8d72-57cf-471e-8b78-29e42ad67e48 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.165107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8d72-57cf-471e-8b78-29e42ad67e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.180689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9e3a8d72-57cf-471e-8b78-29e42ad67e48 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:37.182592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9e3a8d72-57cf-471e-8b78-29e42ad67e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:37.212335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1137/2271] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:37.224238 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde67a12-eb69-4c22-83d9-f01351d67dbc None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.224729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde67a12-eb69-4c22-83d9-f01351d67dbc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.225140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde67a12-eb69-4c22-83d9-f01351d67dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.264034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1135/2272] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:37 2022] PUT /identity/v3/projects/d58459e314e046bf90526ae51ae07cb2/users/8b0a0c746e624a4ebe8261af6c7b2a42/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:37.269121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de8435-c0ae-4cbd-9275-c4f89e59d78a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.269525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de8435-c0ae-4cbd-9275-c4f89e59d78a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.270118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de8435-c0ae-4cbd-9275-c4f89e59d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.274820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-fde67a12-eb69-4c22-83d9-f01351d67dbc None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:37.276429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fde67a12-eb69-4c22-83d9-f01351d67dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:37.346588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a5de8435-c0ae-4cbd-9275-c4f89e59d78a None None] MFA Rules not processed for user `8b0a0c746e624a4ebe8261af6c7b2a42`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:37.350541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a5de8435-c0ae-4cbd-9275-c4f89e59d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:37.385904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:37.409584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1138/2273] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:37.414134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde67a12-eb69-4c22-83d9-f01351d67dbc None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.429315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde67a12-eb69-4c22-83d9-f01351d67dbc None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.435308 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347a931-9a8f-451f-a5fc-71788013430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.435987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347a931-9a8f-451f-a5fc-71788013430a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.439004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347a931-9a8f-451f-a5fc-71788013430a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.439004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347a931-9a8f-451f-a5fc-71788013430a admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.439004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347a931-9a8f-451f-a5fc-71788013430a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:37.439004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347a931-9a8f-451f-a5fc-71788013430a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.439521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347a931-9a8f-451f-a5fc-71788013430a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.455205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1139/2274] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:37.460528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347a931-9a8f-451f-a5fc-71788013430a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.467271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1136/2275] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:37.474165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de8435-c0ae-4cbd-9275-c4f89e59d78a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.477593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347a931-9a8f-451f-a5fc-71788013430a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.483121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b528d-8bf0-45c3-a6e8-16ef975fd13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.483344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a5de8435-c0ae-4cbd-9275-c4f89e59d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:37.485276 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b528d-8bf0-45c3-a6e8-16ef975fd13f admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.485655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b528d-8bf0-45c3-a6e8-16ef975fd13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.486027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b528d-8bf0-45c3-a6e8-16ef975fd13f admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.486802 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b528d-8bf0-45c3-a6e8-16ef975fd13f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.488861 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b528d-8bf0-45c3-a6e8-16ef975fd13f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.505304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de8435-c0ae-4cbd-9275-c4f89e59d78a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.511485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e9a98-cde9-4510-b7f5-5598fe275573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.512646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e9a98-cde9-4510-b7f5-5598fe275573 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.512781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e9a98-cde9-4510-b7f5-5598fe275573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.512983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e9a98-cde9-4510-b7f5-5598fe275573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.513730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e9a98-cde9-4510-b7f5-5598fe275573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.515952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e9a98-cde9-4510-b7f5-5598fe275573 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.591971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1140/2276] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:37 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:37.596758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b528d-8bf0-45c3-a6e8-16ef975fd13f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.628726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1137/2277] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:37 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:37.630287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e9a98-cde9-4510-b7f5-5598fe275573 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.707656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b528d-8bf0-45c3-a6e8-16ef975fd13f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.759640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e9a98-cde9-4510-b7f5-5598fe275573 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.765206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3d0c6-2334-430d-a379-0870ef198ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.765943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3d0c6-2334-430d-a379-0870ef198ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.766322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3d0c6-2334-430d-a379-0870ef198ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.766716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3d0c6-2334-430d-a379-0870ef198ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.767443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3d0c6-2334-430d-a379-0870ef198ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.783477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3d0c6-2334-430d-a379-0870ef198ea8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.803551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7f47-2593-4fe8-ac0f-3011635dc628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.804310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7f47-2593-4fe8-ac0f-3011635dc628 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.804593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7f47-2593-4fe8-ac0f-3011635dc628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.805714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7f47-2593-4fe8-ac0f-3011635dc628 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.806543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7f47-2593-4fe8-ac0f-3011635dc628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.808620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7f47-2593-4fe8-ac0f-3011635dc628 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.886459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1138/2278] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:37 2022] POST /identity/v3/users => generated 300 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:37.890983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3d0c6-2334-430d-a379-0870ef198ea8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.901958 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3d0c6-2334-430d-a379-0870ef198ea8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.907500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc7c2d-f4e6-47ba-8d80-b032d94f101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.908203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc7c2d-f4e6-47ba-8d80-b032d94f101f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.908485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc7c2d-f4e6-47ba-8d80-b032d94f101f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.908759 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc7c2d-f4e6-47ba-8d80-b032d94f101f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.909406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc7c2d-f4e6-47ba-8d80-b032d94f101f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.911030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc7c2d-f4e6-47ba-8d80-b032d94f101f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.911244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1141/2279] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:37 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:37.915089 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7f47-2593-4fe8-ac0f-3011635dc628 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.924683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1139/2280] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:37.924838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7f47-2593-4fe8-ac0f-3011635dc628 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.925725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc7c2d-f4e6-47ba-8d80-b032d94f101f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.929621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8045c0-a206-4bf7-9e7d-685146d8cfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.930215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8045c0-a206-4bf7-9e7d-685146d8cfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.930500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8045c0-a206-4bf7-9e7d-685146d8cfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.930769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8045c0-a206-4bf7-9e7d-685146d8cfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.931698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8045c0-a206-4bf7-9e7d-685146d8cfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.933306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8045c0-a206-4bf7-9e7d-685146d8cfb8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.935987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc7c2d-f4e6-47ba-8d80-b032d94f101f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.940775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16984c44-57b5-42bf-930e-f65ec5b7fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.941426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16984c44-57b5-42bf-930e-f65ec5b7fd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.941704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16984c44-57b5-42bf-930e-f65ec5b7fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.941977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16984c44-57b5-42bf-930e-f65ec5b7fd65 admin admin] PATH_INFO: `/v3/projects/6dfb8df8318f456ca8254dcefa21b9f4/users/016ade73545641afbed938c58b0a0c0d/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.943515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1142/2281] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:37.948092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8045c0-a206-4bf7-9e7d-685146d8cfb8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.958329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8045c0-a206-4bf7-9e7d-685146d8cfb8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:37.958987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16984c44-57b5-42bf-930e-f65ec5b7fd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dfb8df8318f456ca8254dcefa21b9f4, user_id=016ade73545641afbed938c58b0a0c0d, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.961759 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16984c44-57b5-42bf-930e-f65ec5b7fd65 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.963258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8724-a40f-485b-ab8d-e795361fc27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:37.963878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8724-a40f-485b-ab8d-e795361fc27d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:37.964159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8724-a40f-485b-ab8d-e795361fc27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:37.964432 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8724-a40f-485b-ab8d-e795361fc27d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:37.965096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8724-a40f-485b-ab8d-e795361fc27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:37.966642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8724-a40f-485b-ab8d-e795361fc27d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:37.984198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1143/2282] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:37.986956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8724-a40f-485b-ab8d-e795361fc27d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:37.997146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8724-a40f-485b-ab8d-e795361fc27d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.003032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9ce87-dbea-4f9f-88ce-204786b7f40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.003887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9ce87-dbea-4f9f-88ce-204786b7f40e admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.004177 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9ce87-dbea-4f9f-88ce-204786b7f40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.005160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9ce87-dbea-4f9f-88ce-204786b7f40e admin admin] PATH_INFO: `/v3/projects/af9aed09f6da41c19248a4eb6fb5aaa7/users/4c9004f242f0405797a8f171c5d7aae5/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.022722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9ce87-dbea-4f9f-88ce-204786b7f40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9aed09f6da41c19248a4eb6fb5aaa7, user_id=4c9004f242f0405797a8f171c5d7aae5, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.025724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9ce87-dbea-4f9f-88ce-204786b7f40e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.094067 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1140/2283] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:37 2022] PUT /identity/v3/projects/6dfb8df8318f456ca8254dcefa21b9f4/users/016ade73545641afbed938c58b0a0c0d/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:38.098012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16984c44-57b5-42bf-930e-f65ec5b7fd65 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.125034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1144/2284] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:37 2022] PUT /identity/v3/projects/af9aed09f6da41c19248a4eb6fb5aaa7/users/4c9004f242f0405797a8f171c5d7aae5/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:38.136593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab8961-b0ae-43c3-b213-b5e53a04a99d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.136873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab8961-b0ae-43c3-b213-b5e53a04a99d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.137141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab8961-b0ae-43c3-b213-b5e53a04a99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.176685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-22ab8961-b0ae-43c3-b213-b5e53a04a99d None None] MFA Rules not processed for user `4c9004f242f0405797a8f171c5d7aae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:38.178224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-22ab8961-b0ae-43c3-b213-b5e53a04a99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:38.197730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16984c44-57b5-42bf-930e-f65ec5b7fd65 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.298038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:38.299000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1145/2285] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:38.301741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab8961-b0ae-43c3-b213-b5e53a04a99d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.302315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7adc1-7360-44af-b009-b8da7f993c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.302955 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7adc1-7360-44af-b009-b8da7f993c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.303242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7adc1-7360-44af-b009-b8da7f993c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.303520 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7adc1-7360-44af-b009-b8da7f993c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.304213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7adc1-7360-44af-b009-b8da7f993c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.307136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7adc1-7360-44af-b009-b8da7f993c8a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.316318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab8961-b0ae-43c3-b213-b5e53a04a99d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.331959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1141/2286] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:38.331959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7adc1-7360-44af-b009-b8da7f993c8a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.339679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8817e-0810-4526-9922-56cc82d8dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.340458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8817e-0810-4526-9922-56cc82d8dbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.340847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8817e-0810-4526-9922-56cc82d8dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.341232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8817e-0810-4526-9922-56cc82d8dbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.342077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8817e-0810-4526-9922-56cc82d8dbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.346697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8817e-0810-4526-9922-56cc82d8dbc1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.368029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7adc1-7360-44af-b009-b8da7f993c8a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.368029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691d593-188b-43f3-8005-57bb69f7e85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.368029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691d593-188b-43f3-8005-57bb69f7e85d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.368029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691d593-188b-43f3-8005-57bb69f7e85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.369013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691d593-188b-43f3-8005-57bb69f7e85d admin admin] PATH_INFO: `/v3/projects/6dfb8df8318f456ca8254dcefa21b9f4/users/016ade73545641afbed938c58b0a0c0d/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.370467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691d593-188b-43f3-8005-57bb69f7e85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dfb8df8318f456ca8254dcefa21b9f4, user_id=016ade73545641afbed938c58b0a0c0d, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.373196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691d593-188b-43f3-8005-57bb69f7e85d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.386348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1142/2287] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:38 2022] PUT /identity/v3/projects/6dfb8df8318f456ca8254dcefa21b9f4/users/016ade73545641afbed938c58b0a0c0d/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:38.398170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598549bf-689c-4f5e-b631-2ed9557f777e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.398454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598549bf-689c-4f5e-b631-2ed9557f777e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.398911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598549bf-689c-4f5e-b631-2ed9557f777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.432190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-598549bf-689c-4f5e-b631-2ed9557f777e None None] MFA Rules not processed for user `016ade73545641afbed938c58b0a0c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:38.433438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-598549bf-689c-4f5e-b631-2ed9557f777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:38.471151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1146/2288] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:38 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:38.476081 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8817e-0810-4526-9922-56cc82d8dbc1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.514187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1143/2289] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:38.527099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598549bf-689c-4f5e-b631-2ed9557f777e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.528836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-598549bf-689c-4f5e-b631-2ed9557f777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:38.549868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8817e-0810-4526-9922-56cc82d8dbc1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.554525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1678c9d-ad3c-4355-a202-9cf59608160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.555129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1678c9d-ad3c-4355-a202-9cf59608160a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.555410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1678c9d-ad3c-4355-a202-9cf59608160a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.555684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1678c9d-ad3c-4355-a202-9cf59608160a admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.556618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1678c9d-ad3c-4355-a202-9cf59608160a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.558520 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1678c9d-ad3c-4355-a202-9cf59608160a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.588139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598549bf-689c-4f5e-b631-2ed9557f777e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.636074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e18e7-3d63-4948-85b2-f9082a5e6fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.636613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e18e7-3d63-4948-85b2-f9082a5e6fda service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.636889 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e18e7-3d63-4948-85b2-f9082a5e6fda service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.637160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e18e7-3d63-4948-85b2-f9082a5e6fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.676892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1147/2290] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:38 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:38.681455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1678c9d-ad3c-4355-a202-9cf59608160a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.692214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1678c9d-ad3c-4355-a202-9cf59608160a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.697076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5a9c2-1bd1-4de2-91c5-4839e5647006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.697235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e18e7-3d63-4948-85b2-f9082a5e6fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.697674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5a9c2-1bd1-4de2-91c5-4839e5647006 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.698038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5a9c2-1bd1-4de2-91c5-4839e5647006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.698334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5a9c2-1bd1-4de2-91c5-4839e5647006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.698991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e18e7-3d63-4948-85b2-f9082a5e6fda service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.699110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5a9c2-1bd1-4de2-91c5-4839e5647006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.700753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5a9c2-1bd1-4de2-91c5-4839e5647006 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.709130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1144/2291] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:38.711177 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1148/2292] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:38.715185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e18e7-3d63-4948-85b2-f9082a5e6fda service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.725519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e18e7-3d63-4948-85b2-f9082a5e6fda service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.730195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f278de0-c03d-4947-8a95-1ebb940eff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.730852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278de0-c03d-4947-8a95-1ebb940eff9e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.732584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278de0-c03d-4947-8a95-1ebb940eff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.732584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278de0-c03d-4947-8a95-1ebb940eff9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.732584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f278de0-c03d-4947-8a95-1ebb940eff9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.734897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f278de0-c03d-4947-8a95-1ebb940eff9e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.745005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1145/2293] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:38.748942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:38.750356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5a9c2-1bd1-4de2-91c5-4839e5647006 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:38.760109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5a9c2-1bd1-4de2-91c5-4839e5647006 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:38.764914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3d6aa-464b-4f9b-8d41-3a5fc7e33ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:38.765556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3d6aa-464b-4f9b-8d41-3a5fc7e33ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.765832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3d6aa-464b-4f9b-8d41-3a5fc7e33ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.766102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3d6aa-464b-4f9b-8d41-3a5fc7e33ec1 admin admin] PATH_INFO: `/v3/projects/a8d233b8e5f2404a90a53f0c1ff60243/users/ad1d27bf8a144f77942bcb6b5724bc38/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.780399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3d6aa-464b-4f9b-8d41-3a5fc7e33ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d233b8e5f2404a90a53f0c1ff60243, user_id=ad1d27bf8a144f77942bcb6b5724bc38, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:38.783197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3d6aa-464b-4f9b-8d41-3a5fc7e33ec1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:38.869000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1149/2294] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:38 2022] PUT /identity/v3/projects/a8d233b8e5f2404a90a53f0c1ff60243/users/ad1d27bf8a144f77942bcb6b5724bc38/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:38.880313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78dcab-d7ce-48f3-b839-d2c395acbc7b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:38.880594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78dcab-d7ce-48f3-b839-d2c395acbc7b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:38.880865 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78dcab-d7ce-48f3-b839-d2c395acbc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:38.911541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-af78dcab-d7ce-48f3-b839-d2c395acbc7b None None] MFA Rules not processed for user `ad1d27bf8a144f77942bcb6b5724bc38`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:38.912788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-af78dcab-d7ce-48f3-b839-d2c395acbc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:38.983905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1146/2295] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:38.988670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3d6aa-464b-4f9b-8d41-3a5fc7e33ec1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.067201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3d6aa-464b-4f9b-8d41-3a5fc7e33ec1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.072033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0888a2-70c1-4653-af31-4af5eceb8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.072634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0888a2-70c1-4653-af31-4af5eceb8cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.073016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0888a2-70c1-4653-af31-4af5eceb8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.073704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0888a2-70c1-4653-af31-4af5eceb8cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.074714 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0888a2-70c1-4653-af31-4af5eceb8cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.077408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0888a2-70c1-4653-af31-4af5eceb8cfe admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.239402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1150/2296] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:38 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:39.240486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78dcab-d7ce-48f3-b839-d2c395acbc7b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.251566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78dcab-d7ce-48f3-b839-d2c395acbc7b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.320625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccc996-f12f-4bdc-914f-8bfc02587338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.321413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc996-f12f-4bdc-914f-8bfc02587338 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.321693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc996-f12f-4bdc-914f-8bfc02587338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.321963 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc996-f12f-4bdc-914f-8bfc02587338 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.323313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccc996-f12f-4bdc-914f-8bfc02587338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.325186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccc996-f12f-4bdc-914f-8bfc02587338 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.415498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1147/2297] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:39 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:39.419598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0888a2-70c1-4653-af31-4af5eceb8cfe admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.430802 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0888a2-70c1-4653-af31-4af5eceb8cfe admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.436200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d834e-5807-43a0-875c-7d6b141ab13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.437906 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d834e-5807-43a0-875c-7d6b141ab13d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.437906 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d834e-5807-43a0-875c-7d6b141ab13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.437906 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d834e-5807-43a0-875c-7d6b141ab13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.438201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d834e-5807-43a0-875c-7d6b141ab13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.439918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d834e-5807-43a0-875c-7d6b141ab13d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.460603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1151/2298] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:39.464459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccc996-f12f-4bdc-914f-8bfc02587338 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.476509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccc996-f12f-4bdc-914f-8bfc02587338 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.482300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27cdf8-7617-4c2a-b4b0-89c1638bf91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.482942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27cdf8-7617-4c2a-b4b0-89c1638bf91e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.483330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27cdf8-7617-4c2a-b4b0-89c1638bf91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.483831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27cdf8-7617-4c2a-b4b0-89c1638bf91e admin admin] PATH_INFO: `/v3/projects/c4df8a35a4f34751b63c72655345d49e/users/7a012025c7a9427cb3d1513849f81e8c/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.510060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27cdf8-7617-4c2a-b4b0-89c1638bf91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4df8a35a4f34751b63c72655345d49e, user_id=7a012025c7a9427cb3d1513849f81e8c, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.513276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27cdf8-7617-4c2a-b4b0-89c1638bf91e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.515048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:39.632737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1148/2299] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:39 2022] PUT /identity/v3/projects/c4df8a35a4f34751b63c72655345d49e/users/7a012025c7a9427cb3d1513849f81e8c/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:39.633967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d834e-5807-43a0-875c-7d6b141ab13d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.645675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d834e-5807-43a0-875c-7d6b141ab13d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.732346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a70ad-f49a-456e-8e63-70dfe774b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.733401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a70ad-f49a-456e-8e63-70dfe774b8da admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.737464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a70ad-f49a-456e-8e63-70dfe774b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.737464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a70ad-f49a-456e-8e63-70dfe774b8da admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.737464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a70ad-f49a-456e-8e63-70dfe774b8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.737464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a70ad-f49a-456e-8e63-70dfe774b8da admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.748551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1152/2300] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:39.753664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27cdf8-7617-4c2a-b4b0-89c1638bf91e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.772915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27cdf8-7617-4c2a-b4b0-89c1638bf91e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:39.787197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9395a-ed98-4e90-b5d6-8fea125e2e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:39.788270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9395a-ed98-4e90-b5d6-8fea125e2e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.788569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9395a-ed98-4e90-b5d6-8fea125e2e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.788894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9395a-ed98-4e90-b5d6-8fea125e2e1e admin admin] PATH_INFO: `/v3/projects/c4df8a35a4f34751b63c72655345d49e/users/7a012025c7a9427cb3d1513849f81e8c/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.791514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9395a-ed98-4e90-b5d6-8fea125e2e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4df8a35a4f34751b63c72655345d49e, user_id=7a012025c7a9427cb3d1513849f81e8c, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:39.797616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9395a-ed98-4e90-b5d6-8fea125e2e1e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:39.818711 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1149/2301] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:39 2022] PUT /identity/v3/projects/c4df8a35a4f34751b63c72655345d49e/users/7a012025c7a9427cb3d1513849f81e8c/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:39.832703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380c5ed-861f-41be-9831-995120fa2edd None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:39.832991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380c5ed-861f-41be-9831-995120fa2edd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:39.833271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380c5ed-861f-41be-9831-995120fa2edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:39.866849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9380c5ed-861f-41be-9831-995120fa2edd None None] MFA Rules not processed for user `7a012025c7a9427cb3d1513849f81e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:39.868243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9380c5ed-861f-41be-9831-995120fa2edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:39.946789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1153/2302] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:39.965242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9395a-ed98-4e90-b5d6-8fea125e2e1e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:39.966989 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a2c9395a-ed98-4e90-b5d6-8fea125e2e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:40.044763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9395a-ed98-4e90-b5d6-8fea125e2e1e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.048721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32396f00-fcf6-465a-86e0-4a64fd466538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.049411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32396f00-fcf6-465a-86e0-4a64fd466538 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.050081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32396f00-fcf6-465a-86e0-4a64fd466538 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.050464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32396f00-fcf6-465a-86e0-4a64fd466538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.063683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32396f00-fcf6-465a-86e0-4a64fd466538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.065565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32396f00-fcf6-465a-86e0-4a64fd466538 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.076533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1150/2303] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:40.230857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380c5ed-861f-41be-9831-995120fa2edd None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.231402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32396f00-fcf6-465a-86e0-4a64fd466538 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.238261 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32396f00-fcf6-465a-86e0-4a64fd466538 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.251012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564a5d-d4ad-41a6-b228-b91ff1679f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.252069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564a5d-d4ad-41a6-b228-b91ff1679f7d service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.252708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564a5d-d4ad-41a6-b228-b91ff1679f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.253720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564a5d-d4ad-41a6-b228-b91ff1679f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.258515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:40.368630 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3564a5d-d4ad-41a6-b228-b91ff1679f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.370622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3564a5d-d4ad-41a6-b228-b91ff1679f7d service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.371432 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380c5ed-861f-41be-9831-995120fa2edd None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.378166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.378525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.379176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.379176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] PATH_INFO: `/v3/users/8b0a0c746e624a4ebe8261af6c7b2a42` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.381107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0a0c746e624a4ebe8261af6c7b2a42)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.383649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.403578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1151/2304] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:40.404693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564a5d-d4ad-41a6-b228-b91ff1679f7d service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.419181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564a5d-d4ad-41a6-b228-b91ff1679f7d service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:40.423678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c40e6f-1a95-43d7-91b1-563afb82c38a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:40.424431 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40e6f-1a95-43d7-91b1-563afb82c38a service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.424659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40e6f-1a95-43d7-91b1-563afb82c38a service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.424984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40e6f-1a95-43d7-91b1-563afb82c38a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.427073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-16c40e6f-1a95-43d7-91b1-563afb82c38a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:40.510066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c40e6f-1a95-43d7-91b1-563afb82c38a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:40.511638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c40e6f-1a95-43d7-91b1-563afb82c38a service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:40.525423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1152/2305] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:40.571331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0a0c746e624a4ebe8261af6c7b2a42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:40.590828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0a0c746e624a4ebe8261af6c7b2a42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:40.594041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:40.629368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0a0c746e624a4ebe8261af6c7b2a42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:40.631117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0a0c746e624a4ebe8261af6c7b2a42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:40.632020 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0a0c746e624a4ebe8261af6c7b2a42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:40.713811 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1154/2306] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:40 2022] DELETE /identity/v3/users/8b0a0c746e624a4ebe8261af6c7b2a42 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:40.719334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34920d1-cfd6-4c5d-86c8-5787ce6f2213 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:40.719606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34920d1-cfd6-4c5d-86c8-5787ce6f2213 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:40.719929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34920d1-cfd6-4c5d-86c8-5787ce6f2213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:40.772425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a34920d1-cfd6-4c5d-86c8-5787ce6f2213 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:40.774238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a34920d1-cfd6-4c5d-86c8-5787ce6f2213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:40.915405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1153/2307] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:40.933340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:40.935976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:41.027107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec3bfd-0078-407f-b572-4463e39ffdc0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:41.031961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ae40-d259-4622-a80e-29c8323573b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:41.032830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ae40-d259-4622-a80e-29c8323573b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:41.033293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ae40-d259-4622-a80e-29c8323573b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:41.033715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ae40-d259-4622-a80e-29c8323573b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:41.047862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852ae40-d259-4622-a80e-29c8323573b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:41.050737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852ae40-d259-4622-a80e-29c8323573b0 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:41.064657 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1155/2308] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:41.692259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:42.041995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34920d1-cfd6-4c5d-86c8-5787ce6f2213 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:42.043536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a34920d1-cfd6-4c5d-86c8-5787ce6f2213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:42.056922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34920d1-cfd6-4c5d-86c8-5787ce6f2213 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:42.070423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:42.070423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.070423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.070423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] PATH_INFO: `/v3/projects/d58459e314e046bf90526ae51ae07cb2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.070753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58459e314e046bf90526ae51ae07cb2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:42.072537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:42.352953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58459e314e046bf90526ae51ae07cb2', 'request_id': 'req-9eba1447-c3e0-4f0f-94da-12e6765e7c78'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.365608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58459e314e046bf90526ae51ae07cb2', 'request_id': 'req-9eba1447-c3e0-4f0f-94da-12e6765e7c78'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.365608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58459e314e046bf90526ae51ae07cb2', 'request_id': 'req-9eba1447-c3e0-4f0f-94da-12e6765e7c78'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.505324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] The token cache is being invalidate because project d58459e314e046bf90526ae51ae07cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:42.508907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.508907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.512433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1154/2309] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:42 2022] DELETE /identity/v3/projects/d58459e314e046bf90526ae51ae07cb2 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:42.513717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ae40-d259-4622-a80e-29c8323573b0 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:42.524291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ae40-d259-4622-a80e-29c8323573b0 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:42.557137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:42.585519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:42.586156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:42.586437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:42.586718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] PATH_INFO: `/v3/users/016ade73545641afbed938c58b0a0c0d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:42.587894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] RBAC: Authorizing `identity:delete_user(user_id=016ade73545641afbed938c58b0a0c0d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:42.590048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:42.837881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016ade73545641afbed938c58b0a0c0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.844930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016ade73545641afbed938c58b0a0c0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.857320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016ade73545641afbed938c58b0a0c0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.858125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016ade73545641afbed938c58b0a0c0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.858756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-00a5a466-3c15-490d-b8f2-e72cc68f181c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016ade73545641afbed938c58b0a0c0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:42.972172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1156/2310] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:42 2022] DELETE /identity/v3/users/016ade73545641afbed938c58b0a0c0d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:43.023379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.401358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.402785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:43.416062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba1447-c3e0-4f0f-94da-12e6765e7c78 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.473911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.474551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.474828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.475102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] PATH_INFO: `/v3/projects/6dfb8df8318f456ca8254dcefa21b9f4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.476283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dfb8df8318f456ca8254dcefa21b9f4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.478194 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.519122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.608617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dfb8df8318f456ca8254dcefa21b9f4', 'request_id': 'req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:43.615709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dfb8df8318f456ca8254dcefa21b9f4', 'request_id': 'req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:43.622791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dfb8df8318f456ca8254dcefa21b9f4', 'request_id': 'req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:43.654074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:43.709436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] The token cache is being invalidate because project 6dfb8df8318f456ca8254dcefa21b9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:43.709688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:43.710333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b3b78321-9fd7-45d5-ac81-f5ef291a66b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:43.712162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1155/2311] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:43 2022] DELETE /identity/v3/projects/6dfb8df8318f456ca8254dcefa21b9f4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:43.717028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d809b-dd8d-43c1-8e61-d736a3ffa8f6 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.717322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d809b-dd8d-43c1-8e61-d736a3ffa8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.717639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d809b-dd8d-43c1-8e61-d736a3ffa8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.744455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a23d809b-dd8d-43c1-8e61-d736a3ffa8f6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:43.745423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a23d809b-dd8d-43c1-8e61-d736a3ffa8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:43.834821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1157/2312] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:43.843927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be901c-3391-4efd-9c2f-705a17e7af9f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.844214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be901c-3391-4efd-9c2f-705a17e7af9f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.844486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be901c-3391-4efd-9c2f-705a17e7af9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.868243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a4be901c-3391-4efd-9c2f-705a17e7af9f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:43.869551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a4be901c-3391-4efd-9c2f-705a17e7af9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:43.884232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d809b-dd8d-43c1-8e61-d736a3ffa8f6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.907698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d809b-dd8d-43c1-8e61-d736a3ffa8f6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.908607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1156/2313] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:43.913290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9210e-32bd-422d-985d-e544e5109fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.913970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9210e-32bd-422d-985d-e544e5109fab admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.914312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9210e-32bd-422d-985d-e544e5109fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.914644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9210e-32bd-422d-985d-e544e5109fab admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.915364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9210e-32bd-422d-985d-e544e5109fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:43.915726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9210e-32bd-422d-985d-e544e5109fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.917620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9210e-32bd-422d-985d-e544e5109fab admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:43.932503 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1158/2314] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:43.937299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be901c-3391-4efd-9c2f-705a17e7af9f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:43.949806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be901c-3391-4efd-9c2f-705a17e7af9f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:43.956046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175279b9-3379-4aa2-a796-985cef53504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:43.956662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175279b9-3379-4aa2-a796-985cef53504f admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:43.956942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175279b9-3379-4aa2-a796-985cef53504f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:43.957214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175279b9-3379-4aa2-a796-985cef53504f admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:43.957854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175279b9-3379-4aa2-a796-985cef53504f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:43.959860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175279b9-3379-4aa2-a796-985cef53504f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.085348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1157/2315] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:43 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:44.092152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9210e-32bd-422d-985d-e544e5109fab admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:44.104482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9210e-32bd-422d-985d-e544e5109fab admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.175038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2025f-cf66-4c85-ac7f-53617f88feba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.175735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2025f-cf66-4c85-ac7f-53617f88feba admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.176222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2025f-cf66-4c85-ac7f-53617f88feba admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.176715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2025f-cf66-4c85-ac7f-53617f88feba admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.177424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2025f-cf66-4c85-ac7f-53617f88feba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.179549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2025f-cf66-4c85-ac7f-53617f88feba admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.296606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1159/2316] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:44 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:44.296787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175279b9-3379-4aa2-a796-985cef53504f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:44.307289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175279b9-3379-4aa2-a796-985cef53504f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.312086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e46a-3c38-441f-bff5-71526d0edb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.312712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e46a-3c38-441f-bff5-71526d0edb08 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.312992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e46a-3c38-441f-bff5-71526d0edb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.313255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e46a-3c38-441f-bff5-71526d0edb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.313925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67e46a-3c38-441f-bff5-71526d0edb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.319118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67e46a-3c38-441f-bff5-71526d0edb08 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.328852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1158/2317] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:44.330485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2025f-cf66-4c85-ac7f-53617f88feba admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:44.342055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2025f-cf66-4c85-ac7f-53617f88feba admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.347476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807b18c-bbca-472a-b11a-3970419f1816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.348106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807b18c-bbca-472a-b11a-3970419f1816 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.348387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807b18c-bbca-472a-b11a-3970419f1816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.348664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807b18c-bbca-472a-b11a-3970419f1816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.349320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807b18c-bbca-472a-b11a-3970419f1816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.350886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807b18c-bbca-472a-b11a-3970419f1816 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.362170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1160/2318] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:44.366811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e46a-3c38-441f-bff5-71526d0edb08 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:44.377231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e46a-3c38-441f-bff5-71526d0edb08 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.382288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30257-a8e1-4891-a634-263103cb57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.382941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30257-a8e1-4891-a634-263103cb57fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.383276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30257-a8e1-4891-a634-263103cb57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.383490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30257-a8e1-4891-a634-263103cb57fd admin admin] PATH_INFO: `/v3/projects/80c8b51ad2834fd4bbba77cbc54d1713/users/e464e8c95fc04b4a8404ed9e46c768a5/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.402036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f30257-a8e1-4891-a634-263103cb57fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c8b51ad2834fd4bbba77cbc54d1713, user_id=e464e8c95fc04b4a8404ed9e46c768a5, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.404934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f30257-a8e1-4891-a634-263103cb57fd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.499012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1159/2319] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:44 2022] PUT /identity/v3/projects/80c8b51ad2834fd4bbba77cbc54d1713/users/e464e8c95fc04b4a8404ed9e46c768a5/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:44.508460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d4228-ddd0-4a29-8862-dfbbf427213a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.508750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d4228-ddd0-4a29-8862-dfbbf427213a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.509038 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d4228-ddd0-4a29-8862-dfbbf427213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.513662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:44.543159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-361d4228-ddd0-4a29-8862-dfbbf427213a None None] MFA Rules not processed for user `e464e8c95fc04b4a8404ed9e46c768a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:44.544421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-361d4228-ddd0-4a29-8862-dfbbf427213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:44.618398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1161/2320] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:44.628348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30257-a8e1-4891-a634-263103cb57fd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:44.630183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b0f30257-a8e1-4891-a634-263103cb57fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:44.660953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:44.691847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30257-a8e1-4891-a634-263103cb57fd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:44.695456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d408138-7e3e-43e1-bfe7-709c1a665134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:44.696089 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d408138-7e3e-43e1-bfe7-709c1a665134 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:44.696368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d408138-7e3e-43e1-bfe7-709c1a665134 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:44.696637 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d408138-7e3e-43e1-bfe7-709c1a665134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:44.705441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d408138-7e3e-43e1-bfe7-709c1a665134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:44.706873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d408138-7e3e-43e1-bfe7-709c1a665134 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:44.715598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1160/2321] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:44.798917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:45.679037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:45.846206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:46.279432 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d4228-ddd0-4a29-8862-dfbbf427213a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:46.281558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-361d4228-ddd0-4a29-8862-dfbbf427213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:46.346957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d4228-ddd0-4a29-8862-dfbbf427213a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:46.351390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:46.352069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:46.352348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:46.352623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] PATH_INFO: `/v3/users/4c9004f242f0405797a8f171c5d7aae5` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:46.353766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9004f242f0405797a8f171c5d7aae5)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:46.355677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:46.386191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:46.569917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9004f242f0405797a8f171c5d7aae5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:46.577784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9004f242f0405797a8f171c5d7aae5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:46.589554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9004f242f0405797a8f171c5d7aae5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:46.590260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9004f242f0405797a8f171c5d7aae5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:46.590864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9004f242f0405797a8f171c5d7aae5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:46.662919 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1162/2322] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:46 2022] DELETE /identity/v3/users/4c9004f242f0405797a8f171c5d7aae5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:46.667460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83bc0-9549-4c99-aeb8-78c68b2ee472 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:46.667844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83bc0-9549-4c99-aeb8-78c68b2ee472 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:46.668127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83bc0-9549-4c99-aeb8-78c68b2ee472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:46.689821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9be83bc0-9549-4c99-aeb8-78c68b2ee472 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:46.691187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9be83bc0-9549-4c99-aeb8-78c68b2ee472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:46.733227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:46.753881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1161/2323] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:46.763765 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:46.766330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:46.823436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa27f39-9f34-4a14-b3e5-93ca1aec1b62 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:46.827610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0befc1-dba3-4ed2-92a3-a974a84caa8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:46.828243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0befc1-dba3-4ed2-92a3-a974a84caa8e service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:46.828522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0befc1-dba3-4ed2-92a3-a974a84caa8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:46.828798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0befc1-dba3-4ed2-92a3-a974a84caa8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:46.837833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0befc1-dba3-4ed2-92a3-a974a84caa8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:46.839253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0befc1-dba3-4ed2-92a3-a974a84caa8e service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:46.849363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1163/2324] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:47.200768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:47.366587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:47.367946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83bc0-9549-4c99-aeb8-78c68b2ee472 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:47.369556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9be83bc0-9549-4c99-aeb8-78c68b2ee472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:47.382206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83bc0-9549-4c99-aeb8-78c68b2ee472 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:47.387198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:47.387966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.388310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.388650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] PATH_INFO: `/v3/projects/af9aed09f6da41c19248a4eb6fb5aaa7` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.390559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9aed09f6da41c19248a4eb6fb5aaa7)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:47.392588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:47.503615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:47.527703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9aed09f6da41c19248a4eb6fb5aaa7', 'request_id': 'req-b30c0358-e023-4ffb-88fb-5bbc03178fc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:47.536652 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9aed09f6da41c19248a4eb6fb5aaa7', 'request_id': 'req-b30c0358-e023-4ffb-88fb-5bbc03178fc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:47.543834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9aed09f6da41c19248a4eb6fb5aaa7', 'request_id': 'req-b30c0358-e023-4ffb-88fb-5bbc03178fc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:47.580807 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:47.673733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] The token cache is being invalidate because project af9aed09f6da41c19248a4eb6fb5aaa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:47.681843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:47.681843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:47.681843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1162/2325] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:47 2022] DELETE /identity/v3/projects/af9aed09f6da41c19248a4eb6fb5aaa7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:47.682943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0befc1-dba3-4ed2-92a3-a974a84caa8e service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:47.693561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0befc1-dba3-4ed2-92a3-a974a84caa8e service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:47.758184 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:47.763217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:47.763511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:47.765521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] PATH_INFO: `/v3/users/ad1d27bf8a144f77942bcb6b5724bc38` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:47.779948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1d27bf8a144f77942bcb6b5724bc38)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:47.779948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:48.012920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1d27bf8a144f77942bcb6b5724bc38'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:48.022739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1d27bf8a144f77942bcb6b5724bc38'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:48.036705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1d27bf8a144f77942bcb6b5724bc38'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:48.037709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1d27bf8a144f77942bcb6b5724bc38'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:48.038477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1d27bf8a144f77942bcb6b5724bc38'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:48.166616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1164/2326] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:47 2022] DELETE /identity/v3/users/ad1d27bf8a144f77942bcb6b5724bc38 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:48.189710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.301987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.794496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:48.796817 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:48.812529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c0358-e023-4ffb-88fb-5bbc03178fc5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:48.869533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:48.876900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:48.877659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:48.878002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:48.878435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] PATH_INFO: `/v3/projects/a8d233b8e5f2404a90a53f0c1ff60243` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:48.879622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d233b8e5f2404a90a53f0c1ff60243)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:48.881775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:49.046631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d233b8e5f2404a90a53f0c1ff60243', 'request_id': 'req-3610f48a-9bfa-41e5-8584-c8de3b80dc46'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.052839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d233b8e5f2404a90a53f0c1ff60243', 'request_id': 'req-3610f48a-9bfa-41e5-8584-c8de3b80dc46'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.058535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d233b8e5f2404a90a53f0c1ff60243', 'request_id': 'req-3610f48a-9bfa-41e5-8584-c8de3b80dc46'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.175770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] The token cache is being invalidate because project a8d233b8e5f2404a90a53f0c1ff60243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:49.176055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.176664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.178160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1163/2327] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:48 2022] DELETE /identity/v3/projects/a8d233b8e5f2404a90a53f0c1ff60243 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:49.182336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:49.183722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:49.196486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60371efb-ba0f-4333-a5dd-cb5a6a3287e9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:49.257744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:49.258389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:49.258674 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:49.258954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] PATH_INFO: `/v3/users/7a012025c7a9427cb3d1513849f81e8c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:49.260132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a012025c7a9427cb3d1513849f81e8c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:49.262483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:49.474960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:49.488818 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a012025c7a9427cb3d1513849f81e8c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.495431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a012025c7a9427cb3d1513849f81e8c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.507226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a012025c7a9427cb3d1513849f81e8c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.507995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a012025c7a9427cb3d1513849f81e8c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.508600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a012025c7a9427cb3d1513849f81e8c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:49.604963 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1165/2328] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:49 2022] DELETE /identity/v3/users/7a012025c7a9427cb3d1513849f81e8c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:49.621702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:50.157935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:50.159446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:50.173083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610f48a-9bfa-41e5-8584-c8de3b80dc46 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:50.256243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:50.256884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.257159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.257428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] PATH_INFO: `/v3/projects/c4df8a35a4f34751b63c72655345d49e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.258555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4df8a35a4f34751b63c72655345d49e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:50.260501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:50.347076 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:50.348672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:50.362011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e12cd7-f487-4e60-9e32-aab289c09b50 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:50.372232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4df8a35a4f34751b63c72655345d49e', 'request_id': 'req-135f56c2-6dab-4193-a4b0-a81e87c0d71a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.379353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4df8a35a4f34751b63c72655345d49e', 'request_id': 'req-135f56c2-6dab-4193-a4b0-a81e87c0d71a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.384925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4df8a35a4f34751b63c72655345d49e', 'request_id': 'req-135f56c2-6dab-4193-a4b0-a81e87c0d71a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.422275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:50.422918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.423203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.423480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] PATH_INFO: `/v3/users/e464e8c95fc04b4a8404ed9e46c768a5` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.424646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e464e8c95fc04b4a8404ed9e46c768a5)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:50.426571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:50.474204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] The token cache is being invalidate because project c4df8a35a4f34751b63c72655345d49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:50.474500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.475134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-135f56c2-6dab-4193-a4b0-a81e87c0d71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.476787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1164/2329] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:50 2022] DELETE /identity/v3/projects/c4df8a35a4f34751b63c72655345d49e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:50.487114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a41d65-6b61-4dc6-9a70-1c3273fe44f1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.487603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a41d65-6b61-4dc6-9a70-1c3273fe44f1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.488168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a41d65-6b61-4dc6-9a70-1c3273fe44f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.511486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e3a41d65-6b61-4dc6-9a70-1c3273fe44f1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:50.512663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e3a41d65-6b61-4dc6-9a70-1c3273fe44f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:50.521700 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1165/2330] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:50.532663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce7168-1c80-4713-9cfc-381bb4ff00f9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.534287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce7168-1c80-4713-9cfc-381bb4ff00f9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.534287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce7168-1c80-4713-9cfc-381bb4ff00f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.554406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-94ce7168-1c80-4713-9cfc-381bb4ff00f9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:50.556834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:50.557815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-94ce7168-1c80-4713-9cfc-381bb4ff00f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:50.567965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1166/2331] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:50.572804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce7168-1c80-4713-9cfc-381bb4ff00f9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:50.582637 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce7168-1c80-4713-9cfc-381bb4ff00f9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:50.587473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4d8c1-7dbb-41e4-bd23-7c412ff6420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:50.588091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4d8c1-7dbb-41e4-bd23-7c412ff6420d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.588368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4d8c1-7dbb-41e4-bd23-7c412ff6420d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.588635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4d8c1-7dbb-41e4-bd23-7c412ff6420d admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.589280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4d8c1-7dbb-41e4-bd23-7c412ff6420d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:50.589579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4d8c1-7dbb-41e4-bd23-7c412ff6420d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:50.591167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4d8c1-7dbb-41e4-bd23-7c412ff6420d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:50.604057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1167/2332] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:50.608591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4d8c1-7dbb-41e4-bd23-7c412ff6420d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:50.618307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4d8c1-7dbb-41e4-bd23-7c412ff6420d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:50.622951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d23a-aab3-4faf-93ff-bc51a9a53660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:50.623506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d23a-aab3-4faf-93ff-bc51a9a53660 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.623812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d23a-aab3-4faf-93ff-bc51a9a53660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.624117 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34d23a-aab3-4faf-93ff-bc51a9a53660 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.624788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d23a-aab3-4faf-93ff-bc51a9a53660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:50.626651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34d23a-aab3-4faf-93ff-bc51a9a53660 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:50.631014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:50.644764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e464e8c95fc04b4a8404ed9e46c768a5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.651692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e464e8c95fc04b4a8404ed9e46c768a5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.664005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e464e8c95fc04b4a8404ed9e46c768a5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.666320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e464e8c95fc04b4a8404ed9e46c768a5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.666320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3c90620a-420a-4dbf-867a-0b6a87b561ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e464e8c95fc04b4a8404ed9e46c768a5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:50.749089 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1166/2333] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:50 2022] DELETE /identity/v3/users/e464e8c95fc04b4a8404ed9e46c768a5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:50.750597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1168/2334] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:50 2022] POST /identity/v3/projects => generated 359 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:50.763080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcb629-5caa-49b5-906c-ab3397bcbf88 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.763564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcb629-5caa-49b5-906c-ab3397bcbf88 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.764067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcb629-5caa-49b5-906c-ab3397bcbf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.764300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d23a-aab3-4faf-93ff-bc51a9a53660 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:50.766580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7f34d23a-aab3-4faf-93ff-bc51a9a53660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:50.785564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-29bcb629-5caa-49b5-906c-ab3397bcbf88 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:50.786757 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-29bcb629-5caa-49b5-906c-ab3397bcbf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:50.836935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34d23a-aab3-4faf-93ff-bc51a9a53660 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:50.841828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b53cc-60c3-4fcb-bc98-f2f0f8aebd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:50.842430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b53cc-60c3-4fcb-bc98-f2f0f8aebd5a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.842836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b53cc-60c3-4fcb-bc98-f2f0f8aebd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.843249 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b53cc-60c3-4fcb-bc98-f2f0f8aebd5a admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.844189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b53cc-60c3-4fcb-bc98-f2f0f8aebd5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:50.846503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b53cc-60c3-4fcb-bc98-f2f0f8aebd5a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:50.863166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1167/2335] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:50.864249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcb629-5caa-49b5-906c-ab3397bcbf88 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:50.865690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-29bcb629-5caa-49b5-906c-ab3397bcbf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:50.880983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcb629-5caa-49b5-906c-ab3397bcbf88 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:50.883271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:50.888014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:50.888653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:50.888968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:50.889452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] PATH_INFO: `/v3/users/db97ff2985a146c2852832c07979a152` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:50.892096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db97ff2985a146c2852832c07979a152)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:50.894379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:50.983473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1169/2336] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:50 2022] POST /identity/v3/users => generated 280 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:50.984440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b53cc-60c3-4fcb-bc98-f2f0f8aebd5a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:50.986027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-807b53cc-60c3-4fcb-bc98-f2f0f8aebd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:51.042618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b53cc-60c3-4fcb-bc98-f2f0f8aebd5a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.046279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3cef0-9b7d-4ae2-8011-a4cdc5bcc6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.046879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3cef0-9b7d-4ae2-8011-a4cdc5bcc6aa service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.047156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3cef0-9b7d-4ae2-8011-a4cdc5bcc6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.047427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3cef0-9b7d-4ae2-8011-a4cdc5bcc6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.056591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3cef0-9b7d-4ae2-8011-a4cdc5bcc6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.057959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3cef0-9b7d-4ae2-8011-a4cdc5bcc6aa service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:51.068078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1170/2337] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:51.069130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3cef0-9b7d-4ae2-8011-a4cdc5bcc6aa service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:51.079349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3cef0-9b7d-4ae2-8011-a4cdc5bcc6aa service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.084422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78f08-d9e8-4c0d-8d35-a6dc98348afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.085130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78f08-d9e8-4c0d-8d35-a6dc98348afb admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.087173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78f08-d9e8-4c0d-8d35-a6dc98348afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.087173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78f08-d9e8-4c0d-8d35-a6dc98348afb admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.087173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d78f08-d9e8-4c0d-8d35-a6dc98348afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.087877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d78f08-d9e8-4c0d-8d35-a6dc98348afb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:51.098658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1171/2338] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:51.102492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78f08-d9e8-4c0d-8d35-a6dc98348afb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:51.115185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78f08-d9e8-4c0d-8d35-a6dc98348afb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.122710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23134a-cf56-4d91-9041-37631cf72e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.123703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23134a-cf56-4d91-9041-37631cf72e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.125242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23134a-cf56-4d91-9041-37631cf72e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.125789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23134a-cf56-4d91-9041-37631cf72e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.126885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23134a-cf56-4d91-9041-37631cf72e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.128793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23134a-cf56-4d91-9041-37631cf72e7f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:51.141959 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1172/2339] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:51.147513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23134a-cf56-4d91-9041-37631cf72e7f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:51.157939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23134a-cf56-4d91-9041-37631cf72e7f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.162605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c039616-138f-48b6-a1b0-f9076e723f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.163352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c039616-138f-48b6-a1b0-f9076e723f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.163769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c039616-138f-48b6-a1b0-f9076e723f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.164202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c039616-138f-48b6-a1b0-f9076e723f6d admin admin] PATH_INFO: `/v3/projects/13af064b5da5403983b6638b4def7c56/users/3ed3bc6a31fe413e8d249d723a17165b/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.185953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c039616-138f-48b6-a1b0-f9076e723f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13af064b5da5403983b6638b4def7c56, user_id=3ed3bc6a31fe413e8d249d723a17165b, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.189812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c039616-138f-48b6-a1b0-f9076e723f6d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:51.201824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db97ff2985a146c2852832c07979a152'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:51.210220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db97ff2985a146c2852832c07979a152'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:51.223710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db97ff2985a146c2852832c07979a152'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:51.224485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db97ff2985a146c2852832c07979a152'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:51.225330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b8c90ddc-4ddb-44e8-a32a-acc71bbd8ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db97ff2985a146c2852832c07979a152'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:51.228909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:51.375525 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1168/2340] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:50 2022] DELETE /identity/v3/users/db97ff2985a146c2852832c07979a152 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:51.380175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1173/2341] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:51 2022] PUT /identity/v3/projects/13af064b5da5403983b6638b4def7c56/users/3ed3bc6a31fe413e8d249d723a17165b/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:51.381841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8693-ebd6-4406-8414-04dbd9cc864b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.382353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8693-ebd6-4406-8414-04dbd9cc864b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.382834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8693-ebd6-4406-8414-04dbd9cc864b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.398981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4ea9-ec86-421f-950b-d1db3606a18d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.398981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4ea9-ec86-421f-950b-d1db3606a18d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.398981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4ea9-ec86-421f-950b-d1db3606a18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.424637 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-59ba8693-ebd6-4406-8414-04dbd9cc864b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:51.427804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-59ba8693-ebd6-4406-8414-04dbd9cc864b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:51.436536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-51af4ea9-ec86-421f-950b-d1db3606a18d None None] MFA Rules not processed for user `3ed3bc6a31fe413e8d249d723a17165b`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:51.438280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-51af4ea9-ec86-421f-950b-d1db3606a18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:51.526612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:51.531088 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1174/2342] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:51.545530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba8693-ebd6-4406-8414-04dbd9cc864b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:51.551480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-59ba8693-ebd6-4406-8414-04dbd9cc864b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:51.571062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1169/2343] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:51.622274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4ea9-ec86-421f-950b-d1db3606a18d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:51.624741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-51af4ea9-ec86-421f-950b-d1db3606a18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:51.649473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba8693-ebd6-4406-8414-04dbd9cc864b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.654325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53158d-ee46-4890-b502-7e33bf816d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.656476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53158d-ee46-4890-b502-7e33bf816d39 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.656822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53158d-ee46-4890-b502-7e33bf816d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.657296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53158d-ee46-4890-b502-7e33bf816d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.668413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53158d-ee46-4890-b502-7e33bf816d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.670094 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53158d-ee46-4890-b502-7e33bf816d39 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:51.682252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1175/2344] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:51.708200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4ea9-ec86-421f-950b-d1db3606a18d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.714884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425420a-4ecd-46fa-b008-064cc7c181c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.714884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425420a-4ecd-46fa-b008-064cc7c181c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.714884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425420a-4ecd-46fa-b008-064cc7c181c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.714884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425420a-4ecd-46fa-b008-064cc7c181c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.739580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425420a-4ecd-46fa-b008-064cc7c181c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.743596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425420a-4ecd-46fa-b008-064cc7c181c8 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:51.753079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1170/2345] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:51.768900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53158d-ee46-4890-b502-7e33bf816d39 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:51.771637 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:51.773043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5f53158d-ee46-4890-b502-7e33bf816d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:51.787809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53158d-ee46-4890-b502-7e33bf816d39 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.792579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.793202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.793475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.793746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] PATH_INFO: `/v3/users/3ed3bc6a31fe413e8d249d723a17165b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.794928 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed3bc6a31fe413e8d249d723a17165b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.797615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:51.887637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425420a-4ecd-46fa-b008-064cc7c181c8 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:51.887637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e425420a-4ecd-46fa-b008-064cc7c181c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:51.915569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425420a-4ecd-46fa-b008-064cc7c181c8 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:51.922849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:51.923276 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:51.923276 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:51.923489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] PATH_INFO: `/v3/projects/80c8b51ad2834fd4bbba77cbc54d1713` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:51.924671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c8b51ad2834fd4bbba77cbc54d1713)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:51.926580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:52.033801 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:52.047483 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed3bc6a31fe413e8d249d723a17165b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.048289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed3bc6a31fe413e8d249d723a17165b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.119422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c8b51ad2834fd4bbba77cbc54d1713', 'request_id': 'req-763dd8cb-5078-467f-9785-e9c34e206cf1'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.126005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c8b51ad2834fd4bbba77cbc54d1713', 'request_id': 'req-763dd8cb-5078-467f-9785-e9c34e206cf1'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.223147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed3bc6a31fe413e8d249d723a17165b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.223817 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed3bc6a31fe413e8d249d723a17165b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.237177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34e63933-8e4c-496a-85d4-fae0f0926580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed3bc6a31fe413e8d249d723a17165b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.251005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1176/2346] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:22:51 2022] DELETE /identity/v3/users/3ed3bc6a31fe413e8d249d723a17165b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:52.255359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e64154-0fb4-4f10-abb6-4fb0e54b45ea None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:52.255643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e64154-0fb4-4f10-abb6-4fb0e54b45ea None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:52.255947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e64154-0fb4-4f10-abb6-4fb0e54b45ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:52.275606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-67e64154-0fb4-4f10-abb6-4fb0e54b45ea None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:52.276844 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-67e64154-0fb4-4f10-abb6-4fb0e54b45ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:52.317250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:52.337621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1177/2347] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:52.347166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e64154-0fb4-4f10-abb6-4fb0e54b45ea None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:52.348515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-67e64154-0fb4-4f10-abb6-4fb0e54b45ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:52.354397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c8b51ad2834fd4bbba77cbc54d1713', 'request_id': 'req-763dd8cb-5078-467f-9785-e9c34e206cf1'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.377354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] The token cache is being invalidate because project 80c8b51ad2834fd4bbba77cbc54d1713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:52.377912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.378777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.381478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1171/2348] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:51 2022] DELETE /identity/v3/projects/80c8b51ad2834fd4bbba77cbc54d1713 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:52.383382 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:52.386833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:52.454326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:52.455138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e64154-0fb4-4f10-abb6-4fb0e54b45ea None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:52.459892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d760fcd-9322-412f-8f45-26d2ff148bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:52.461857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d760fcd-9322-412f-8f45-26d2ff148bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:52.461857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d760fcd-9322-412f-8f45-26d2ff148bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:52.461857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d760fcd-9322-412f-8f45-26d2ff148bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:52.463640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2d760fcd-9322-412f-8f45-26d2ff148bb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:52.478636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d760fcd-9322-412f-8f45-26d2ff148bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:52.480170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d760fcd-9322-412f-8f45-26d2ff148bb0 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:52.487556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:52.495790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1178/2349] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:52.498348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a20d2-0b45-4707-898a-f8dcecdfec3d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:52.498348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a20d2-0b45-4707-898a-f8dcecdfec3d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:52.498348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a20d2-0b45-4707-898a-f8dcecdfec3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:52.525301 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-219a20d2-0b45-4707-898a-f8dcecdfec3d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:52.527510 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-219a20d2-0b45-4707-898a-f8dcecdfec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:52.546680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1179/2350] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:52.553937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da263c0-eee3-443f-8d14-579e696b6e6b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:52.554225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da263c0-eee3-443f-8d14-579e696b6e6b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:52.554501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da263c0-eee3-443f-8d14-579e696b6e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:52.554671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd8cb-5078-467f-9785-e9c34e206cf1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:52.559871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:52.564383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:52.564383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:52.564383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] PATH_INFO: `/v3/projects/c4d29173030848c2a3407492e07d2147` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:52.564383 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d29173030848c2a3407492e07d2147)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:52.566384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:52.581740 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8da263c0-eee3-443f-8d14-579e696b6e6b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:52.583219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8da263c0-eee3-443f-8d14-579e696b6e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:52.594695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1180/2351] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:52.599150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da263c0-eee3-443f-8d14-579e696b6e6b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:52.610113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da263c0-eee3-443f-8d14-579e696b6e6b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:52.615259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960709a-efe6-42bd-8dc1-6c9ffd0d9e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:52.616172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960709a-efe6-42bd-8dc1-6c9ffd0d9e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:52.616452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960709a-efe6-42bd-8dc1-6c9ffd0d9e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:52.616709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960709a-efe6-42bd-8dc1-6c9ffd0d9e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:52.617686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960709a-efe6-42bd-8dc1-6c9ffd0d9e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:52.617996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960709a-efe6-42bd-8dc1-6c9ffd0d9e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:52.620021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960709a-efe6-42bd-8dc1-6c9ffd0d9e99 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:52.642808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1181/2352] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:22:52.644279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960709a-efe6-42bd-8dc1-6c9ffd0d9e99 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:52.657762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960709a-efe6-42bd-8dc1-6c9ffd0d9e99 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:52.662776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37315fd-20e8-4885-9787-7ed928003b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:52.663572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37315fd-20e8-4885-9787-7ed928003b0c admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:52.664045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37315fd-20e8-4885-9787-7ed928003b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:52.664387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37315fd-20e8-4885-9787-7ed928003b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:52.665035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37315fd-20e8-4885-9787-7ed928003b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:52.667447 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37315fd-20e8-4885-9787-7ed928003b0c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:52.804067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d29173030848c2a3407492e07d2147', 'request_id': 'req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.820433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d29173030848c2a3407492e07d2147', 'request_id': 'req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.826311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:52.836858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1182/2353] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:52 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:52.840933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37315fd-20e8-4885-9787-7ed928003b0c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:52.913138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37315fd-20e8-4885-9787-7ed928003b0c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:52.918606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1525d-691a-49ba-b464-9398e9849e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:52.919444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1525d-691a-49ba-b464-9398e9849e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:52.919572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1525d-691a-49ba-b464-9398e9849e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:52.919785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1525d-691a-49ba-b464-9398e9849e42 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:52.920426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1525d-691a-49ba-b464-9398e9849e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:52.922628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1525d-691a-49ba-b464-9398e9849e42 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:52.976507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d29173030848c2a3407492e07d2147', 'request_id': 'req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.988371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] The token cache is being invalidate because project c4d29173030848c2a3407492e07d2147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:52.988752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.989485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:52.991062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1172/2354] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:52 2022] DELETE /identity/v3/projects/c4d29173030848c2a3407492e07d2147 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:53.112157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:53.136254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1183/2355] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:52 2022] POST /identity/v3/users => generated 284 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:53.145359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:53.147441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:53.227877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9dd8c-798c-4fb3-9ebd-2efd4fc43ecf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:53.233098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4fd3b-8bad-447b-a7df-467e741dc1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:53.233814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4fd3b-8bad-447b-a7df-467e741dc1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.234087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4fd3b-8bad-447b-a7df-467e741dc1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.234354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4fd3b-8bad-447b-a7df-467e741dc1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.234992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4fd3b-8bad-447b-a7df-467e741dc1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:53.236622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4fd3b-8bad-447b-a7df-467e741dc1e2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:53.246782 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1173/2356] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:53.251660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1525d-691a-49ba-b464-9398e9849e42 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:53.262027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1525d-691a-49ba-b464-9398e9849e42 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:53.267385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab271cc-3256-4fb6-be28-3a1db98196f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:53.268025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab271cc-3256-4fb6-be28-3a1db98196f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.268379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab271cc-3256-4fb6-be28-3a1db98196f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.275477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab271cc-3256-4fb6-be28-3a1db98196f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.275477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab271cc-3256-4fb6-be28-3a1db98196f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:53.275477 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab271cc-3256-4fb6-be28-3a1db98196f8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:53.289812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1184/2357] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:53.294223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4fd3b-8bad-447b-a7df-467e741dc1e2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:53.304967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4fd3b-8bad-447b-a7df-467e741dc1e2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:53.310065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cf3f3-2ee9-43ad-812a-5d13250f4992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:53.310719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf3f3-2ee9-43ad-812a-5d13250f4992 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.313326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf3f3-2ee9-43ad-812a-5d13250f4992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.313326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf3f3-2ee9-43ad-812a-5d13250f4992 admin admin] PATH_INFO: `/v3/projects/2e6d475707fa4c20bffce332bb399da3/users/89ae4fe1082747e58208309b2359dee8/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.326979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cf3f3-2ee9-43ad-812a-5d13250f4992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e6d475707fa4c20bffce332bb399da3, user_id=89ae4fe1082747e58208309b2359dee8, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:53.330499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cf3f3-2ee9-43ad-812a-5d13250f4992 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:53.339061 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab271cc-3256-4fb6-be28-3a1db98196f8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:53.341099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6ab271cc-3256-4fb6-be28-3a1db98196f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:53.357260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab271cc-3256-4fb6-be28-3a1db98196f8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:53.364381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:53.365083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.365347 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.365663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] PATH_INFO: `/v3/projects/13af064b5da5403983b6638b4def7c56` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.366877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13af064b5da5403983b6638b4def7c56)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:53.371166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:53.446251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1174/2358] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:53 2022] PUT /identity/v3/projects/2e6d475707fa4c20bffce332bb399da3/users/89ae4fe1082747e58208309b2359dee8/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:53.457758 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87427bb1-1091-46c5-a37e-e3b236eea679 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.458045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87427bb1-1091-46c5-a37e-e3b236eea679 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.458311 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87427bb1-1091-46c5-a37e-e3b236eea679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.486394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-87427bb1-1091-46c5-a37e-e3b236eea679 None None] MFA Rules not processed for user `89ae4fe1082747e58208309b2359dee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:53.487603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-87427bb1-1091-46c5-a37e-e3b236eea679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:53.519690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13af064b5da5403983b6638b4def7c56', 'request_id': 'req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:53.526472 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13af064b5da5403983b6638b4def7c56', 'request_id': 'req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:53.532152 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13af064b5da5403983b6638b4def7c56', 'request_id': 'req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:53.556795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1175/2359] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:53.569167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87427bb1-1091-46c5-a37e-e3b236eea679 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:53.570466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-87427bb1-1091-46c5-a37e-e3b236eea679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:53.635972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87427bb1-1091-46c5-a37e-e3b236eea679 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:53.646162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] The token cache is being invalidate because project 13af064b5da5403983b6638b4def7c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:22:53.651492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:53.651492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4b9e5ad7-688f-43c3-a8f9-b2af94c74b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:22:53.651492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1185/2360] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:22:53 2022] DELETE /identity/v3/projects/13af064b5da5403983b6638b4def7c56 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:22:53.654274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bc7cd-889d-40b4-ab06-1cd565a71ac9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.654627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bc7cd-889d-40b4-ab06-1cd565a71ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.654973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bc7cd-889d-40b4-ab06-1cd565a71ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.677256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ab9bc7cd-889d-40b4-ab06-1cd565a71ac9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:53.678134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ab9bc7cd-889d-40b4-ab06-1cd565a71ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:53.690206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5ec8-28b7-4573-918a-05a0cf3322ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8855e3e7fc84cd9ba1afaef4cc308c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:53.690968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5ec8-28b7-4573-918a-05a0cf3322ce service glance] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.691349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5ec8-28b7-4573-918a-05a0cf3322ce service glance] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.691719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5ec8-28b7-4573-918a-05a0cf3322ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.693596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fcfe5ec8-28b7-4573-918a-05a0cf3322ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:53.747025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1186/2361] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:53.755977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c372bb-98e4-4bb4-85cd-6f71492bbbe5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.756362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c372bb-98e4-4bb4-85cd-6f71492bbbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.756733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c372bb-98e4-4bb4-85cd-6f71492bbbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.767336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5ec8-28b7-4573-918a-05a0cf3322ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:53.769106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5ec8-28b7-4573-918a-05a0cf3322ce service glance] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:53.780784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1176/2362] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:22:53.781777 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-12c372bb-98e4-4bb4-85cd-6f71492bbbe5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:53.783096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-12c372bb-98e4-4bb4-85cd-6f71492bbbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:53.800953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1187/2363] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:53.801047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5ec8-28b7-4573-918a-05a0cf3322ce service glance] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:53.810721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5ec8-28b7-4573-918a-05a0cf3322ce service glance] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:53.820575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c1436-d5a1-453c-a413-c0dea235ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:53.821326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c1436-d5a1-453c-a413-c0dea235ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.822077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c1436-d5a1-453c-a413-c0dea235ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.822427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c1436-d5a1-453c-a413-c0dea235ad94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.823528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c1436-d5a1-453c-a413-c0dea235ad94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:22:53.823944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c1436-d5a1-453c-a413-c0dea235ad94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:53.830385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c1436-d5a1-453c-a413-c0dea235ad94 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:53.848106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1177/2364] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:22:53.852338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c372bb-98e4-4bb4-85cd-6f71492bbbe5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:53.862032 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c372bb-98e4-4bb4-85cd-6f71492bbbe5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:53.866716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda43de7-a736-45c3-91b6-7768c73c6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:53.871181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda43de7-a736-45c3-91b6-7768c73c6cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:53.871534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda43de7-a736-45c3-91b6-7768c73c6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:53.871736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda43de7-a736-45c3-91b6-7768c73c6cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:53.872466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda43de7-a736-45c3-91b6-7768c73c6cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:53.875006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda43de7-a736-45c3-91b6-7768c73c6cb6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.005411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1188/2365] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:53 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:54.006853 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c1436-d5a1-453c-a413-c0dea235ad94 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.018388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c1436-d5a1-453c-a413-c0dea235ad94 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.069600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:54.111561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f243c7-a094-4674-9f8f-a719a5db3716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.112239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f243c7-a094-4674-9f8f-a719a5db3716 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.112513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f243c7-a094-4674-9f8f-a719a5db3716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.113125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f243c7-a094-4674-9f8f-a719a5db3716 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.115434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f243c7-a094-4674-9f8f-a719a5db3716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.116015 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f243c7-a094-4674-9f8f-a719a5db3716 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.231868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1178/2366] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:54 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:54.234864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda43de7-a736-45c3-91b6-7768c73c6cb6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.253216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda43de7-a736-45c3-91b6-7768c73c6cb6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.260828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68fbbf-a457-4931-99db-8e605f5a6994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.261543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68fbbf-a457-4931-99db-8e605f5a6994 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.261821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68fbbf-a457-4931-99db-8e605f5a6994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.262090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68fbbf-a457-4931-99db-8e605f5a6994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.262745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68fbbf-a457-4931-99db-8e605f5a6994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.264402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68fbbf-a457-4931-99db-8e605f5a6994 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.276391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1189/2367] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:54.281639 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f243c7-a094-4674-9f8f-a719a5db3716 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.294995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f243c7-a094-4674-9f8f-a719a5db3716 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.300934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d5c53-c768-4347-b895-7836ed30699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.301577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5c53-c768-4347-b895-7836ed30699b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.301829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5c53-c768-4347-b895-7836ed30699b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.302102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d5c53-c768-4347-b895-7836ed30699b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.302796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d5c53-c768-4347-b895-7836ed30699b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.304432 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d5c53-c768-4347-b895-7836ed30699b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.319466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1179/2368] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:54.319641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:54.320693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68fbbf-a457-4931-99db-8e605f5a6994 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.331882 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68fbbf-a457-4931-99db-8e605f5a6994 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.336654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0bdf-87ee-4125-91c5-7a556cbe5391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.337301 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0bdf-87ee-4125-91c5-7a556cbe5391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.337579 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0bdf-87ee-4125-91c5-7a556cbe5391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.337855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0bdf-87ee-4125-91c5-7a556cbe5391 admin admin] PATH_INFO: `/v3/projects/ca0e5f2f633b48d8986802b24507335c/users/c33de20b291a4996b993c95448bef4ae/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.353564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f0bdf-87ee-4125-91c5-7a556cbe5391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0e5f2f633b48d8986802b24507335c, user_id=c33de20b291a4996b993c95448bef4ae, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.356386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f0bdf-87ee-4125-91c5-7a556cbe5391 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:54.595549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1190/2369] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:54 2022] PUT /identity/v3/projects/ca0e5f2f633b48d8986802b24507335c/users/c33de20b291a4996b993c95448bef4ae/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:54.606060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6fa99-ee8e-48dd-86a1-8e755e55ab4a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.613107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6fa99-ee8e-48dd-86a1-8e755e55ab4a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.613107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6fa99-ee8e-48dd-86a1-8e755e55ab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.636690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-86c6fa99-ee8e-48dd-86a1-8e755e55ab4a None None] MFA Rules not processed for user `c33de20b291a4996b993c95448bef4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:54.638108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-86c6fa99-ee8e-48dd-86a1-8e755e55ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:54.703505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1180/2370] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:54.708015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0bdf-87ee-4125-91c5-7a556cbe5391 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:54.769100 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0bdf-87ee-4125-91c5-7a556cbe5391 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:54.773712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738dc1c-a95f-4ead-b75d-dcd7c30c5e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:54.774308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738dc1c-a95f-4ead-b75d-dcd7c30c5e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:54.774614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738dc1c-a95f-4ead-b75d-dcd7c30c5e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:54.774938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738dc1c-a95f-4ead-b75d-dcd7c30c5e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:54.775576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738dc1c-a95f-4ead-b75d-dcd7c30c5e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:54.777513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738dc1c-a95f-4ead-b75d-dcd7c30c5e78 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:55.821156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1191/2371] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:54 2022] POST /identity/v3/projects => generated 383 bytes in 1114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:55.825351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6fa99-ee8e-48dd-86a1-8e755e55ab4a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:55.841055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6fa99-ee8e-48dd-86a1-8e755e55ab4a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:55.967971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2484-e4dd-49c6-8939-9aa651f2f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:55.970244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2484-e4dd-49c6-8939-9aa651f2f24c admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:55.971075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2484-e4dd-49c6-8939-9aa651f2f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:55.971473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2484-e4dd-49c6-8939-9aa651f2f24c admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:55.972404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd2484-e4dd-49c6-8939-9aa651f2f24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:55.984339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd2484-e4dd-49c6-8939-9aa651f2f24c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:56.098816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1181/2372] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:55 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:56.100167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738dc1c-a95f-4ead-b75d-dcd7c30c5e78 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:56.111797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738dc1c-a95f-4ead-b75d-dcd7c30c5e78 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:56.117650 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c9c3e-acfc-4451-99da-e6fa7156da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:56.118286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c9c3e-acfc-4451-99da-e6fa7156da84 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.118550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c9c3e-acfc-4451-99da-e6fa7156da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.118821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c9c3e-acfc-4451-99da-e6fa7156da84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.119466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c9c3e-acfc-4451-99da-e6fa7156da84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:56.121109 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c9c3e-acfc-4451-99da-e6fa7156da84 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:56.133717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1192/2373] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:56.137787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2484-e4dd-49c6-8939-9aa651f2f24c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:56.148508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2484-e4dd-49c6-8939-9aa651f2f24c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:56.153511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64a30f-a6e0-413b-a11a-2faa8b811a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:56.154192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64a30f-a6e0-413b-a11a-2faa8b811a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.154662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64a30f-a6e0-413b-a11a-2faa8b811a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.155098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64a30f-a6e0-413b-a11a-2faa8b811a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.155973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64a30f-a6e0-413b-a11a-2faa8b811a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:56.162116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64a30f-a6e0-413b-a11a-2faa8b811a4d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:56.169362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1182/2374] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:56.178366 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c9c3e-acfc-4451-99da-e6fa7156da84 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:56.190323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c9c3e-acfc-4451-99da-e6fa7156da84 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:56.195898 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34101ce5-d158-44fb-aa2d-1a72365bf9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:56.197938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34101ce5-d158-44fb-aa2d-1a72365bf9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.197938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34101ce5-d158-44fb-aa2d-1a72365bf9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.197938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34101ce5-d158-44fb-aa2d-1a72365bf9f6 admin admin] PATH_INFO: `/v3/projects/000fb943d3794209b3eb711034e7707e/users/90b5c828c29d4f0bb6538959190e60ea/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.212722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34101ce5-d158-44fb-aa2d-1a72365bf9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000fb943d3794209b3eb711034e7707e, user_id=90b5c828c29d4f0bb6538959190e60ea, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:56.215388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34101ce5-d158-44fb-aa2d-1a72365bf9f6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:56.305038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1193/2375] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:56 2022] PUT /identity/v3/projects/000fb943d3794209b3eb711034e7707e/users/90b5c828c29d4f0bb6538959190e60ea/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:56.308171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408916c-cb09-42e4-be73-f0eb86b9149f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.308612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408916c-cb09-42e4-be73-f0eb86b9149f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.309111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408916c-cb09-42e4-be73-f0eb86b9149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.342988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4408916c-cb09-42e4-be73-f0eb86b9149f None None] MFA Rules not processed for user `90b5c828c29d4f0bb6538959190e60ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:56.344626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4408916c-cb09-42e4-be73-f0eb86b9149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:56.440955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1183/2376] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:22:56.449442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34101ce5-d158-44fb-aa2d-1a72365bf9f6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:56.522847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34101ce5-d158-44fb-aa2d-1a72365bf9f6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:56.527883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee0d2b-497a-4d1a-973a-942035d4c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:56.528493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee0d2b-497a-4d1a-973a-942035d4c193 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.528776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee0d2b-497a-4d1a-973a-942035d4c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.529230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee0d2b-497a-4d1a-973a-942035d4c193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.529868 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee0d2b-497a-4d1a-973a-942035d4c193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:56.532238 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee0d2b-497a-4d1a-973a-942035d4c193 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:56.676740 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1194/2377] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:22:56 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:22:56.681643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408916c-cb09-42e4-be73-f0eb86b9149f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:56.695407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408916c-cb09-42e4-be73-f0eb86b9149f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:56.771573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3114f5d-699d-4291-9e29-efe5386d4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:56.772216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3114f5d-699d-4291-9e29-efe5386d4773 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.772495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3114f5d-699d-4291-9e29-efe5386d4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.772766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3114f5d-699d-4291-9e29-efe5386d4773 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.773395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3114f5d-699d-4291-9e29-efe5386d4773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:56.775329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3114f5d-699d-4291-9e29-efe5386d4773 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:56.786032 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:56.878539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1184/2378] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:22:56 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:22:56.882600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee0d2b-497a-4d1a-973a-942035d4c193 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:56.898455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee0d2b-497a-4d1a-973a-942035d4c193 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:56.905229 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe21711-8431-406c-a3be-99f5f25ac8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:56.907291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe21711-8431-406c-a3be-99f5f25ac8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.908687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe21711-8431-406c-a3be-99f5f25ac8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.914323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe21711-8431-406c-a3be-99f5f25ac8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.915885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe21711-8431-406c-a3be-99f5f25ac8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:56.918124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe21711-8431-406c-a3be-99f5f25ac8cf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:56.939797 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1195/2379] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:22:56.941731 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3114f5d-699d-4291-9e29-efe5386d4773 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:56.959370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3114f5d-699d-4291-9e29-efe5386d4773 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:56.967284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d606f0-9f21-4490-9faf-656920744546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:56.968812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d606f0-9f21-4490-9faf-656920744546 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:56.969080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d606f0-9f21-4490-9faf-656920744546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:56.969631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d606f0-9f21-4490-9faf-656920744546 admin admin] PATH_INFO: `/v3/projects/816988f008574d51be0d9d9a9543c9fb/users/48d8bf8f31f245a5a5a055c2497daf84/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:56.995347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d606f0-9f21-4490-9faf-656920744546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816988f008574d51be0d9d9a9543c9fb, user_id=48d8bf8f31f245a5a5a055c2497daf84, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:57.011349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d606f0-9f21-4490-9faf-656920744546 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:57.075773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1185/2380] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:56 2022] PUT /identity/v3/projects/816988f008574d51be0d9d9a9543c9fb/users/48d8bf8f31f245a5a5a055c2497daf84/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:57.079808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe21711-8431-406c-a3be-99f5f25ac8cf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:57.090127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe21711-8431-406c-a3be-99f5f25ac8cf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:57.130500 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:57.166187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d59f-029c-4341-bd15-c335d65069f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:57.166861 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d59f-029c-4341-bd15-c335d65069f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:57.167140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d59f-029c-4341-bd15-c335d65069f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:57.167410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d59f-029c-4341-bd15-c335d65069f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:57.168202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295d59f-029c-4341-bd15-c335d65069f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:57.170083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295d59f-029c-4341-bd15-c335d65069f9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:57.179298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:57.187780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1196/2381] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:22:57.189731 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d606f0-9f21-4490-9faf-656920744546 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:57.200960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d606f0-9f21-4490-9faf-656920744546 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:57.206084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9bf8f-7cbb-4a92-976e-3608603ca734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:57.206776 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9bf8f-7cbb-4a92-976e-3608603ca734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:57.207055 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9bf8f-7cbb-4a92-976e-3608603ca734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:57.207337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9bf8f-7cbb-4a92-976e-3608603ca734 admin admin] PATH_INFO: `/v3/projects/816988f008574d51be0d9d9a9543c9fb/users/48d8bf8f31f245a5a5a055c2497daf84/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:57.209408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9bf8f-7cbb-4a92-976e-3608603ca734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816988f008574d51be0d9d9a9543c9fb, user_id=48d8bf8f31f245a5a5a055c2497daf84, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:57.212155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9bf8f-7cbb-4a92-976e-3608603ca734 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:57.225495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1186/2382] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:22:57 2022] PUT /identity/v3/projects/816988f008574d51be0d9d9a9543c9fb/users/48d8bf8f31f245a5a5a055c2497daf84/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:22:57.236449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c7b3-7f6e-41f5-a825-3648ba2f5fe8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:57.236841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c7b3-7f6e-41f5-a825-3648ba2f5fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:57.237181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c7b3-7f6e-41f5-a825-3648ba2f5fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:57.271731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-56e5c7b3-7f6e-41f5-a825-3648ba2f5fe8 None None] MFA Rules not processed for user `48d8bf8f31f245a5a5a055c2497daf84`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:22:57.274258 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-56e5c7b3-7f6e-41f5-a825-3648ba2f5fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:57.348923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1197/2383] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:22:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:22:57.366425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9bf8f-7cbb-4a92-976e-3608603ca734 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:22:57.366425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6dc9bf8f-7cbb-4a92-976e-3608603ca734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:22:57.427880 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9bf8f-7cbb-4a92-976e-3608603ca734 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:22:57.430701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:57.435274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d003b-1781-4dae-90a3-b068ec04942d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:22:57.435947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d003b-1781-4dae-90a3-b068ec04942d service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:22:57.436201 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d003b-1781-4dae-90a3-b068ec04942d service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:22:57.436473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d003b-1781-4dae-90a3-b068ec04942d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:22:57.495105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d003b-1781-4dae-90a3-b068ec04942d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:22:57.496483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d003b-1781-4dae-90a3-b068ec04942d service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:22:57.505524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1187/2384] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:22:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:22:58.091781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:58.323774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:58.749291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:58.875531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:59.092011 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:59.298147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:59.394551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:22:59.960665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:00.030678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:00.629155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:00.650737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c7b3-7f6e-41f5-a825-3648ba2f5fe8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:00.652167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-56e5c7b3-7f6e-41f5-a825-3648ba2f5fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:00.664482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c7b3-7f6e-41f5-a825-3648ba2f5fe8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:00.668048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a778e4-8dd2-4c5a-b2a2-def9a1331b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:00.668667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a778e4-8dd2-4c5a-b2a2-def9a1331b77 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:00.668944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a778e4-8dd2-4c5a-b2a2-def9a1331b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:00.669212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a778e4-8dd2-4c5a-b2a2-def9a1331b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:00.732436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a778e4-8dd2-4c5a-b2a2-def9a1331b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:00.734402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a778e4-8dd2-4c5a-b2a2-def9a1331b77 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:00.744232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1198/2385] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:01.140698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:01.999254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:02.495242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d003b-1781-4dae-90a3-b068ec04942d service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:02.505577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d003b-1781-4dae-90a3-b068ec04942d service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:02.510345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc5a4-f263-4108-8424-1457d8808333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:02.511351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc5a4-f263-4108-8424-1457d8808333 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:02.511799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc5a4-f263-4108-8424-1457d8808333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:02.512241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc5a4-f263-4108-8424-1457d8808333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:02.522505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bc5a4-f263-4108-8424-1457d8808333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:02.524195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bc5a4-f263-4108-8424-1457d8808333 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:02.535564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1188/2386] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:02.968748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:03.079988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:03.858181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2893018-814e-4cd8-b99c-c611568ca138 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:03.858474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2893018-814e-4cd8-b99c-c611568ca138 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:03.858796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2893018-814e-4cd8-b99c-c611568ca138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:03.886191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b2893018-814e-4cd8-b99c-c611568ca138 None None] MFA Rules not processed for user `422f027c14884f5384f2ed2ff68c82f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:03.888090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b2893018-814e-4cd8-b99c-c611568ca138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:03.960676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1199/2387] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:23:04.492674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:04.578829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:05.634497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:05.840695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc5a4-f263-4108-8424-1457d8808333 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:05.842156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5e7bc5a4-f263-4108-8424-1457d8808333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:05.902025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc5a4-f263-4108-8424-1457d8808333 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:05.907414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39487ad-689c-4366-b516-62fbbc1db003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:05.907414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39487ad-689c-4366-b516-62fbbc1db003 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:05.907414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39487ad-689c-4366-b516-62fbbc1db003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:05.907414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39487ad-689c-4366-b516-62fbbc1db003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:05.908904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d39487ad-689c-4366-b516-62fbbc1db003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:05.979613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39487ad-689c-4366-b516-62fbbc1db003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:05.981575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39487ad-689c-4366-b516-62fbbc1db003 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:05.992664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1189/2388] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:06.612195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:06.923055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:07.314771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:07.818524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:08.113881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:08.540674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2893018-814e-4cd8-b99c-c611568ca138 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:08.616461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2893018-814e-4cd8-b99c-c611568ca138 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:08.621978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:08.622607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:08.623073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:08.623432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] PATH_INFO: `/v3/users/c33de20b291a4996b993c95448bef4ae` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:08.625539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33de20b291a4996b993c95448bef4ae)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:08.627716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:08.854113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:08.879156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33de20b291a4996b993c95448bef4ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:08.880259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33de20b291a4996b993c95448bef4ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:08.940478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:08.966502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33de20b291a4996b993c95448bef4ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:08.967173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33de20b291a4996b993c95448bef4ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:08.990986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33de20b291a4996b993c95448bef4ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:09.018186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1200/2389] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:08 2022] DELETE /identity/v3/users/c33de20b291a4996b993c95448bef4ae => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:09.032826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829da19d-1072-46ed-a4ca-926a44e6a3f6 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:09.033398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829da19d-1072-46ed-a4ca-926a44e6a3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:09.033879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829da19d-1072-46ed-a4ca-926a44e6a3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:09.055171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-829da19d-1072-46ed-a4ca-926a44e6a3f6 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:09.057083 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-829da19d-1072-46ed-a4ca-926a44e6a3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:09.140053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1190/2390] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:09.168411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:09.171117 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:09.276359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5df27d-2c80-4177-a071-01e239d46b00 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:09.289197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557fd7f-33f5-4493-ab35-6afab8f6e9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:09.290695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557fd7f-33f5-4493-ab35-6afab8f6e9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:09.291168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557fd7f-33f5-4493-ab35-6afab8f6e9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:09.294931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557fd7f-33f5-4493-ab35-6afab8f6e9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:09.307976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557fd7f-33f5-4493-ab35-6afab8f6e9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:09.310277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557fd7f-33f5-4493-ab35-6afab8f6e9c1 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:09.323399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1201/2391] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:09.627428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:09.908393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:10.543913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829da19d-1072-46ed-a4ca-926a44e6a3f6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:10.547642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-829da19d-1072-46ed-a4ca-926a44e6a3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:10.573585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829da19d-1072-46ed-a4ca-926a44e6a3f6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:10.593640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:10.593640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:10.593640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:10.593640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] PATH_INFO: `/v3/projects/ca0e5f2f633b48d8986802b24507335c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:10.593952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0e5f2f633b48d8986802b24507335c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:10.593952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:10.795332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0e5f2f633b48d8986802b24507335c', 'request_id': 'req-a81b4638-4579-41f8-b989-3aa1a1b6439e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:10.804804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0e5f2f633b48d8986802b24507335c', 'request_id': 'req-a81b4638-4579-41f8-b989-3aa1a1b6439e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:10.925585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0e5f2f633b48d8986802b24507335c', 'request_id': 'req-a81b4638-4579-41f8-b989-3aa1a1b6439e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:10.936970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] The token cache is being invalidate because project ca0e5f2f633b48d8986802b24507335c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:10.937314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:10.937884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:10.939403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1191/2392] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:10 2022] DELETE /identity/v3/projects/ca0e5f2f633b48d8986802b24507335c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:10.943502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557fd7f-33f5-4493-ab35-6afab8f6e9c1 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:10.953766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557fd7f-33f5-4493-ab35-6afab8f6e9c1 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:11.016247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:11.016887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:11.017166 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:11.017439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] PATH_INFO: `/v3/users/90b5c828c29d4f0bb6538959190e60ea` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:11.018641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b5c828c29d4f0bb6538959190e60ea)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:11.020718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:11.138615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:11.339423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b5c828c29d4f0bb6538959190e60ea'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:11.340102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b5c828c29d4f0bb6538959190e60ea'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:11.457555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b5c828c29d4f0bb6538959190e60ea'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:11.458264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b5c828c29d4f0bb6538959190e60ea'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:11.472294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b5c828c29d4f0bb6538959190e60ea'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:11.485633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1202/2393] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:10 2022] DELETE /identity/v3/users/90b5c828c29d4f0bb6538959190e60ea => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:12.030718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:12.032615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:12.060062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b4638-4579-41f8-b989-3aa1a1b6439e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:12.126666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:12.127578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:12.127908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:12.128381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] PATH_INFO: `/v3/projects/000fb943d3794209b3eb711034e7707e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:12.129523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000fb943d3794209b3eb711034e7707e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:12.131725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:12.337710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000fb943d3794209b3eb711034e7707e', 'request_id': 'req-e655e6c7-b835-470f-9210-5ce3d6d48b53'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.344245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000fb943d3794209b3eb711034e7707e', 'request_id': 'req-e655e6c7-b835-470f-9210-5ce3d6d48b53'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.411498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000fb943d3794209b3eb711034e7707e', 'request_id': 'req-e655e6c7-b835-470f-9210-5ce3d6d48b53'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.424672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] The token cache is being invalidate because project 000fb943d3794209b3eb711034e7707e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:12.425574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.426447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.428627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1192/2394] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:12 2022] DELETE /identity/v3/projects/000fb943d3794209b3eb711034e7707e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:12.432623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:12.434161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:12.448736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ed220-8908-4611-96de-619f9966df62 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:12.510872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:12.511551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:12.511869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:12.512148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] PATH_INFO: `/v3/users/48d8bf8f31f245a5a5a055c2497daf84` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:12.513278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d8bf8f31f245a5a5a055c2497daf84)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:12.515282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:12.521251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:12.759873 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d8bf8f31f245a5a5a055c2497daf84'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.760603 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d8bf8f31f245a5a5a055c2497daf84'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.817667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:12.862966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d8bf8f31f245a5a5a055c2497daf84'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.863933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d8bf8f31f245a5a5a055c2497daf84'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.876954 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e730969-5d76-4a43-8819-1eee7f1be957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d8bf8f31f245a5a5a055c2497daf84'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:12.889027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1203/2395] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:12 2022] DELETE /identity/v3/users/48d8bf8f31f245a5a5a055c2497daf84 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:23:13.361475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:13.363084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:13.378436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655e6c7-b835-470f-9210-5ce3d6d48b53 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:13.444972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:13.445666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:13.445964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:13.446236 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] PATH_INFO: `/v3/projects/816988f008574d51be0d9d9a9543c9fb` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:13.447395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816988f008574d51be0d9d9a9543c9fb)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:13.449330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:13.684763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816988f008574d51be0d9d9a9543c9fb', 'request_id': 'req-40127595-bda7-4ec6-9e41-d8d946b49ae1'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:13.708972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816988f008574d51be0d9d9a9543c9fb', 'request_id': 'req-40127595-bda7-4ec6-9e41-d8d946b49ae1'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:13.896935 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816988f008574d51be0d9d9a9543c9fb', 'request_id': 'req-40127595-bda7-4ec6-9e41-d8d946b49ae1'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:13.908598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] The token cache is being invalidate because project 816988f008574d51be0d9d9a9543c9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:13.908840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:13.909494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-40127595-bda7-4ec6-9e41-d8d946b49ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:13.911045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1193/2396] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:13 2022] DELETE /identity/v3/projects/816988f008574d51be0d9d9a9543c9fb => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:13.916277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de702-0206-42b1-a36f-5c527608ce0e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:13.916809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de702-0206-42b1-a36f-5c527608ce0e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:13.916809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de702-0206-42b1-a36f-5c527608ce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:13.941027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a85de702-0206-42b1-a36f-5c527608ce0e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:13.942674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a85de702-0206-42b1-a36f-5c527608ce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:14.005247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1204/2397] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:14.014479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea97abb-3f4f-4faf-892b-11219a99aaeb None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.014967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea97abb-3f4f-4faf-892b-11219a99aaeb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.015306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea97abb-3f4f-4faf-892b-11219a99aaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.042435 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-cea97abb-3f4f-4faf-892b-11219a99aaeb None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:14.043689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cea97abb-3f4f-4faf-892b-11219a99aaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:14.052420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1194/2398] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:14.057036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85de702-0206-42b1-a36f-5c527608ce0e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.068452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85de702-0206-42b1-a36f-5c527608ce0e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.074182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8dfd2-9e64-4e1d-8d4c-a2cf777d6415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.074897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8dfd2-9e64-4e1d-8d4c-a2cf777d6415 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.079852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8dfd2-9e64-4e1d-8d4c-a2cf777d6415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.079852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8dfd2-9e64-4e1d-8d4c-a2cf777d6415 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.079852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8dfd2-9e64-4e1d-8d4c-a2cf777d6415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:14.079852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8dfd2-9e64-4e1d-8d4c-a2cf777d6415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.079852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8dfd2-9e64-4e1d-8d4c-a2cf777d6415 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.091704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1205/2399] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:14.096914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea97abb-3f4f-4faf-892b-11219a99aaeb None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.106615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea97abb-3f4f-4faf-892b-11219a99aaeb None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.113381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbabc8-2196-4dbd-ab3f-aee74d124d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.114009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbabc8-2196-4dbd-ab3f-aee74d124d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.114291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbabc8-2196-4dbd-ab3f-aee74d124d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.114569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbabc8-2196-4dbd-ab3f-aee74d124d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.115215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbabc8-2196-4dbd-ab3f-aee74d124d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.117347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbabc8-2196-4dbd-ab3f-aee74d124d53 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.229359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1195/2400] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:23:14 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:14.234015 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8dfd2-9e64-4e1d-8d4c-a2cf777d6415 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.245218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8dfd2-9e64-4e1d-8d4c-a2cf777d6415 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.309270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f27a2-2096-4ccb-a5eb-f07085d8ba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.309879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f27a2-2096-4ccb-a5eb-f07085d8ba93 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.310210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f27a2-2096-4ccb-a5eb-f07085d8ba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.310674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f27a2-2096-4ccb-a5eb-f07085d8ba93 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.311357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f27a2-2096-4ccb-a5eb-f07085d8ba93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.313363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f27a2-2096-4ccb-a5eb-f07085d8ba93 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.420295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1206/2401] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:23:14 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:14.422477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbabc8-2196-4dbd-ab3f-aee74d124d53 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.435661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbabc8-2196-4dbd-ab3f-aee74d124d53 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.440656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b66dcb-784f-4791-b05f-def3d15a3d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.441261 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b66dcb-784f-4791-b05f-def3d15a3d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.441537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b66dcb-784f-4791-b05f-def3d15a3d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.441803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b66dcb-784f-4791-b05f-def3d15a3d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.442888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b66dcb-784f-4791-b05f-def3d15a3d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.444536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b66dcb-784f-4791-b05f-def3d15a3d79 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.459137 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1196/2402] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:23:14.473149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f27a2-2096-4ccb-a5eb-f07085d8ba93 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.483003 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f27a2-2096-4ccb-a5eb-f07085d8ba93 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.488309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49051e42-f290-46d5-908a-3bc7f0774d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.488906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051e42-f290-46d5-908a-3bc7f0774d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.489179 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051e42-f290-46d5-908a-3bc7f0774d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.489471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051e42-f290-46d5-908a-3bc7f0774d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.490123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49051e42-f290-46d5-908a-3bc7f0774d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.492183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49051e42-f290-46d5-908a-3bc7f0774d3b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.497279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:14.508165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1207/2403] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:23:14.512326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b66dcb-784f-4791-b05f-def3d15a3d79 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.522806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b66dcb-784f-4791-b05f-def3d15a3d79 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.527471 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46315018-581c-4fea-bd97-2ff3ac41ea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.528161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315018-581c-4fea-bd97-2ff3ac41ea81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.528441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315018-581c-4fea-bd97-2ff3ac41ea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.528725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315018-581c-4fea-bd97-2ff3ac41ea81 admin admin] PATH_INFO: `/v3/projects/64a2866b308442dd9ff4ab5e0ee620dd/users/52afaac30fdd46b9b31a3827b5f524cf/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.544190 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46315018-581c-4fea-bd97-2ff3ac41ea81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a2866b308442dd9ff4ab5e0ee620dd, user_id=52afaac30fdd46b9b31a3827b5f524cf, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.547923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46315018-581c-4fea-bd97-2ff3ac41ea81 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.656135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1197/2404] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:23:14 2022] PUT /identity/v3/projects/64a2866b308442dd9ff4ab5e0ee620dd/users/52afaac30fdd46b9b31a3827b5f524cf/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:14.666409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d6092-3f92-468c-8d95-73733670fc52 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.666694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d6092-3f92-468c-8d95-73733670fc52 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.666968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d6092-3f92-468c-8d95-73733670fc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.697584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-061d6092-3f92-468c-8d95-73733670fc52 None None] MFA Rules not processed for user `52afaac30fdd46b9b31a3827b5f524cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:14.698986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-061d6092-3f92-468c-8d95-73733670fc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:14.777704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1208/2405] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:14.789452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46315018-581c-4fea-bd97-2ff3ac41ea81 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:14.791609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-46315018-581c-4fea-bd97-2ff3ac41ea81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:14.793993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:14.859816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46315018-581c-4fea-bd97-2ff3ac41ea81 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:14.865506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d3358-df84-4a42-8725-567646caf740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:14.866125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d3358-df84-4a42-8725-567646caf740 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:14.866476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d3358-df84-4a42-8725-567646caf740 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:14.873287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d3358-df84-4a42-8725-567646caf740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:14.883435 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d3358-df84-4a42-8725-567646caf740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:14.888321 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d3358-df84-4a42-8725-567646caf740 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:14.895053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1198/2406] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:15.358909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:16.720502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:17.770077 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:17.938275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:19.115846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d6092-3f92-468c-8d95-73733670fc52 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:19.180534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d6092-3f92-468c-8d95-73733670fc52 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:19.185299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:19.185962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:19.186283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:19.186698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] PATH_INFO: `/v3/users/52afaac30fdd46b9b31a3827b5f524cf` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:19.187911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52afaac30fdd46b9b31a3827b5f524cf)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:19.189829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:19.195540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:19.365890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52afaac30fdd46b9b31a3827b5f524cf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:19.366475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52afaac30fdd46b9b31a3827b5f524cf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:19.489786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52afaac30fdd46b9b31a3827b5f524cf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:19.490400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52afaac30fdd46b9b31a3827b5f524cf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:19.503122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52afaac30fdd46b9b31a3827b5f524cf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:19.515085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1209/2407] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:19 2022] DELETE /identity/v3/users/52afaac30fdd46b9b31a3827b5f524cf => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:19.519610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608be7e-b067-4ada-bb91-2124ee7250d1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:19.520122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608be7e-b067-4ada-bb91-2124ee7250d1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:19.520236 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608be7e-b067-4ada-bb91-2124ee7250d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:19.539415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f608be7e-b067-4ada-bb91-2124ee7250d1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:19.540625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f608be7e-b067-4ada-bb91-2124ee7250d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:19.601155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1199/2408] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:19.616256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:19.617654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:19.644869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:19.675378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03695f-464d-489d-bbdd-97f8d89baed9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:19.679178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d3520-3738-409d-be8d-5ca635e98a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:19.682049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d3520-3738-409d-be8d-5ca635e98a49 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:19.682049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d3520-3738-409d-be8d-5ca635e98a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:19.682049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d3520-3738-409d-be8d-5ca635e98a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:19.691338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d3520-3738-409d-be8d-5ca635e98a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:19.693148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d3520-3738-409d-be8d-5ca635e98a49 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:19.705157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1210/2409] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:19.989037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:20.168991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608be7e-b067-4ada-bb91-2124ee7250d1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:20.171789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f608be7e-b067-4ada-bb91-2124ee7250d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:20.194768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:20.204034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608be7e-b067-4ada-bb91-2124ee7250d1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:20.208640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:20.209458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:20.209798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:20.210146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] PATH_INFO: `/v3/projects/64a2866b308442dd9ff4ab5e0ee620dd` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:20.211526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a2866b308442dd9ff4ab5e0ee620dd)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:20.213878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:20.223248 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:20.327571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a2866b308442dd9ff4ab5e0ee620dd', 'request_id': 'req-b0b43d96-ad55-473a-899c-87d51dc2406f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:20.335291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a2866b308442dd9ff4ab5e0ee620dd', 'request_id': 'req-b0b43d96-ad55-473a-899c-87d51dc2406f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:20.410485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:20.434254 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a2866b308442dd9ff4ab5e0ee620dd', 'request_id': 'req-b0b43d96-ad55-473a-899c-87d51dc2406f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:20.447390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] The token cache is being invalidate because project 64a2866b308442dd9ff4ab5e0ee620dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:20.447830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:20.448544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b0b43d96-ad55-473a-899c-87d51dc2406f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:20.450188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1200/2410] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:20 2022] DELETE /identity/v3/projects/64a2866b308442dd9ff4ab5e0ee620dd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:20.458338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db210-ad4b-46a5-9265-ba2e8a43b8c5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:20.458634 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db210-ad4b-46a5-9265-ba2e8a43b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:20.458916 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14db210-ad4b-46a5-9265-ba2e8a43b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:20.479242 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b14db210-ad4b-46a5-9265-ba2e8a43b8c5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:20.480488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b14db210-ad4b-46a5-9265-ba2e8a43b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:20.539980 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1211/2411] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:20.548367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff91e-266e-4fc8-9bbc-2e008815c2f1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:20.548846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff91e-266e-4fc8-9bbc-2e008815c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:20.548967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff91e-266e-4fc8-9bbc-2e008815c2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:20.569557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9f3ff91e-266e-4fc8-9bbc-2e008815c2f1 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:20.570766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9f3ff91e-266e-4fc8-9bbc-2e008815c2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:20.579866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1201/2412] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:20.584318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14db210-ad4b-46a5-9265-ba2e8a43b8c5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:20.594668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14db210-ad4b-46a5-9265-ba2e8a43b8c5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:20.599400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532e5b-8b65-4ac2-981a-7679ad813b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:20.600075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532e5b-8b65-4ac2-981a-7679ad813b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:20.600352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532e5b-8b65-4ac2-981a-7679ad813b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:20.600623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532e5b-8b65-4ac2-981a-7679ad813b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:20.601264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532e5b-8b65-4ac2-981a-7679ad813b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:20.601564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532e5b-8b65-4ac2-981a-7679ad813b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:20.603178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532e5b-8b65-4ac2-981a-7679ad813b73 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:20.614901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1212/2413] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:20.619226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ff91e-266e-4fc8-9bbc-2e008815c2f1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:20.629856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ff91e-266e-4fc8-9bbc-2e008815c2f1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:20.632725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:20.638546 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26478-83a2-44a0-904e-b3f99fb1f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:20.639242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26478-83a2-44a0-904e-b3f99fb1f362 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:20.640404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26478-83a2-44a0-904e-b3f99fb1f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:20.641275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26478-83a2-44a0-904e-b3f99fb1f362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:20.642170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a26478-83a2-44a0-904e-b3f99fb1f362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:20.644266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a26478-83a2-44a0-904e-b3f99fb1f362 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:20.740878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1202/2414] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:23:20 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:20.745533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532e5b-8b65-4ac2-981a-7679ad813b73 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:20.756693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532e5b-8b65-4ac2-981a-7679ad813b73 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:20.820948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d156-a347-4cef-aaca-fa7e368f7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:20.821562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d156-a347-4cef-aaca-fa7e368f7883 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:20.821855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d156-a347-4cef-aaca-fa7e368f7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:20.822108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d156-a347-4cef-aaca-fa7e368f7883 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:20.822741 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056d156-a347-4cef-aaca-fa7e368f7883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:20.824854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056d156-a347-4cef-aaca-fa7e368f7883 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:20.829839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:20.972290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1213/2415] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:23:20 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:20.984494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26478-83a2-44a0-904e-b3f99fb1f362 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:20.995132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26478-83a2-44a0-904e-b3f99fb1f362 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:21.001170 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb79740-a9df-4119-9210-d837b589d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:21.001596 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb79740-a9df-4119-9210-d837b589d5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:21.001875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb79740-a9df-4119-9210-d837b589d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:21.002153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb79740-a9df-4119-9210-d837b589d5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:21.002876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb79740-a9df-4119-9210-d837b589d5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:21.004569 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb79740-a9df-4119-9210-d837b589d5b9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:21.018456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1203/2416] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:23:21.024559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d156-a347-4cef-aaca-fa7e368f7883 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:21.037089 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d156-a347-4cef-aaca-fa7e368f7883 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:21.042999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2890ffa-8f6c-4927-a2c1-c708dc553194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:21.044215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2890ffa-8f6c-4927-a2c1-c708dc553194 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:21.044494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2890ffa-8f6c-4927-a2c1-c708dc553194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:21.044766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2890ffa-8f6c-4927-a2c1-c708dc553194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:21.045414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2890ffa-8f6c-4927-a2c1-c708dc553194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:21.047456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2890ffa-8f6c-4927-a2c1-c708dc553194 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:21.063805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1214/2417] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:23:21.068876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb79740-a9df-4119-9210-d837b589d5b9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:21.079980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb79740-a9df-4119-9210-d837b589d5b9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:21.084929 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76478406-c4bc-4a9f-bf0f-a2b72e09da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:21.085581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76478406-c4bc-4a9f-bf0f-a2b72e09da39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:21.085865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76478406-c4bc-4a9f-bf0f-a2b72e09da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:21.088480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76478406-c4bc-4a9f-bf0f-a2b72e09da39 admin admin] PATH_INFO: `/v3/projects/72a1a0a34dbe4c4d91fee7cfaa1b1423/users/254bd9cc471d4b75a606c849cfb201af/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:21.101898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76478406-c4bc-4a9f-bf0f-a2b72e09da39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a1a0a34dbe4c4d91fee7cfaa1b1423, user_id=254bd9cc471d4b75a606c849cfb201af, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:21.104637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76478406-c4bc-4a9f-bf0f-a2b72e09da39 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:21.179548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:21.188631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1204/2418] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:23:21 2022] PUT /identity/v3/projects/72a1a0a34dbe4c4d91fee7cfaa1b1423/users/254bd9cc471d4b75a606c849cfb201af/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:21.259772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600785-cdb0-4067-aed0-93992ce2f45f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:21.260324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600785-cdb0-4067-aed0-93992ce2f45f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:21.260324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600785-cdb0-4067-aed0-93992ce2f45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:21.290576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4f600785-cdb0-4067-aed0-93992ce2f45f None None] MFA Rules not processed for user `254bd9cc471d4b75a606c849cfb201af`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:21.291943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4f600785-cdb0-4067-aed0-93992ce2f45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:21.369276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1215/2419] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:21.387675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76478406-c4bc-4a9f-bf0f-a2b72e09da39 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:21.389927 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-76478406-c4bc-4a9f-bf0f-a2b72e09da39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:21.400148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:21.460181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76478406-c4bc-4a9f-bf0f-a2b72e09da39 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:21.467286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91502319-8b10-43e4-8c0e-2fd3bce0a138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:21.468666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91502319-8b10-43e4-8c0e-2fd3bce0a138 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:21.468666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91502319-8b10-43e4-8c0e-2fd3bce0a138 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:21.468666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91502319-8b10-43e4-8c0e-2fd3bce0a138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:21.479046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91502319-8b10-43e4-8c0e-2fd3bce0a138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:21.480605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91502319-8b10-43e4-8c0e-2fd3bce0a138 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:21.491178 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1205/2420] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:21.724453 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:22.130135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:22.291456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:22.788428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:22.815925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:23.258766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:23.783493 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:24.040379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:24.314918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:26.744664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600785-cdb0-4067-aed0-93992ce2f45f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:26.746113 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4f600785-cdb0-4067-aed0-93992ce2f45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:26.818481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600785-cdb0-4067-aed0-93992ce2f45f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:26.822944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:26.823570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:26.823874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:26.824143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] PATH_INFO: `/v3/users/a3aa8fadbea6427782aee1f1d2634ee7` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:26.825253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3aa8fadbea6427782aee1f1d2634ee7)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:26.827153 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:27.107005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3aa8fadbea6427782aee1f1d2634ee7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.107656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3aa8fadbea6427782aee1f1d2634ee7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.216675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3aa8fadbea6427782aee1f1d2634ee7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.217304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3aa8fadbea6427782aee1f1d2634ee7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.231159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3aa8fadbea6427782aee1f1d2634ee7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.246453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1216/2421] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:26 2022] DELETE /identity/v3/users/a3aa8fadbea6427782aee1f1d2634ee7 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:27.721961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91502319-8b10-43e4-8c0e-2fd3bce0a138 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:27.735389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91502319-8b10-43e4-8c0e-2fd3bce0a138 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:27.793237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:27.793858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:27.794134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:27.794403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] PATH_INFO: `/v3/projects/d90f8ebd61024dea93000263b29bd0f9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:27.795498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90f8ebd61024dea93000263b29bd0f9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:27.798058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:27.882593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:27.899158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90f8ebd61024dea93000263b29bd0f9', 'request_id': 'req-2844e765-5f0f-44a0-a6d4-ee67677cde9c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.905444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90f8ebd61024dea93000263b29bd0f9', 'request_id': 'req-2844e765-5f0f-44a0-a6d4-ee67677cde9c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.982855 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90f8ebd61024dea93000263b29bd0f9', 'request_id': 'req-2844e765-5f0f-44a0-a6d4-ee67677cde9c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.994462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] The token cache is being invalidate because project d90f8ebd61024dea93000263b29bd0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:27.994839 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.995498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:27.997002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1206/2422] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:27 2022] DELETE /identity/v3/projects/d90f8ebd61024dea93000263b29bd0f9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:23:28.001240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:28.003683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:28.017526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441f378-5d9b-4dc5-a648-54292c74ada7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:28.065377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:28.080788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:28.081439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:28.081716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:28.082036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] PATH_INFO: `/v3/users/ee9c1accb26741c58816371f6c96553a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:28.083452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9c1accb26741c58816371f6c96553a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:28.085414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:28.229386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9c1accb26741c58816371f6c96553a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:28.230156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9c1accb26741c58816371f6c96553a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:28.291456 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9c1accb26741c58816371f6c96553a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:28.292147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9c1accb26741c58816371f6c96553a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:28.304939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b4dd7508-8297-4890-ab5d-00f111bae600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9c1accb26741c58816371f6c96553a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:28.319504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1217/2423] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:28 2022] DELETE /identity/v3/users/ee9c1accb26741c58816371f6c96553a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:28.751600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:28.752693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:28.766663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844e765-5f0f-44a0-a6d4-ee67677cde9c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:28.828704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:28.829333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:28.829613 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:28.829886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] PATH_INFO: `/v3/projects/84e81382caa043e3acd3990a0cb6b497` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:28.830997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e81382caa043e3acd3990a0cb6b497)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:28.832935 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:28.944243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e81382caa043e3acd3990a0cb6b497', 'request_id': 'req-a2a2c47f-b492-44ef-9ca5-d2b946918172'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:28.950447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e81382caa043e3acd3990a0cb6b497', 'request_id': 'req-a2a2c47f-b492-44ef-9ca5-d2b946918172'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:29.028260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e81382caa043e3acd3990a0cb6b497', 'request_id': 'req-a2a2c47f-b492-44ef-9ca5-d2b946918172'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:29.041129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] The token cache is being invalidate because project 84e81382caa043e3acd3990a0cb6b497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:29.041416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:29.042062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a2a2c47f-b492-44ef-9ca5-d2b946918172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:29.043629 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1207/2424] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:28 2022] DELETE /identity/v3/projects/84e81382caa043e3acd3990a0cb6b497 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:29.049433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ce254-af44-455a-8e5b-e535eaf34fce None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.050288 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ce254-af44-455a-8e5b-e535eaf34fce None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.050572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ce254-af44-455a-8e5b-e535eaf34fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.071861 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c05ce254-af44-455a-8e5b-e535eaf34fce None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:29.073421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c05ce254-af44-455a-8e5b-e535eaf34fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:29.139616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1218/2425] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:29.149543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeecdc-510e-41eb-9d93-52af1755c968 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.149826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeecdc-510e-41eb-9d93-52af1755c968 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.150098 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeecdc-510e-41eb-9d93-52af1755c968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.187678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-24aeecdc-510e-41eb-9d93-52af1755c968 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:29.187678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-24aeecdc-510e-41eb-9d93-52af1755c968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:29.195305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1208/2426] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:29.195990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ce254-af44-455a-8e5b-e535eaf34fce None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:29.208265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ce254-af44-455a-8e5b-e535eaf34fce None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:29.214505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af2f65-0d2f-4e50-b71f-f3ca0a51dae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:29.215147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af2f65-0d2f-4e50-b71f-f3ca0a51dae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.215419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af2f65-0d2f-4e50-b71f-f3ca0a51dae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.215774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af2f65-0d2f-4e50-b71f-f3ca0a51dae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.224975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af2f65-0d2f-4e50-b71f-f3ca0a51dae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:29.224975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af2f65-0d2f-4e50-b71f-f3ca0a51dae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:29.224975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af2f65-0d2f-4e50-b71f-f3ca0a51dae1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:29.243034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1219/2427] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:23:29.253865 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aeecdc-510e-41eb-9d93-52af1755c968 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:29.263462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aeecdc-510e-41eb-9d93-52af1755c968 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:29.268312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8919f4b-71d5-449e-98bf-2045e7b91e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:29.268908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8919f4b-71d5-449e-98bf-2045e7b91e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.269187 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8919f4b-71d5-449e-98bf-2045e7b91e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.269592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8919f4b-71d5-449e-98bf-2045e7b91e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.270102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8919f4b-71d5-449e-98bf-2045e7b91e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:29.271998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8919f4b-71d5-449e-98bf-2045e7b91e54 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:29.368382 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1209/2428] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:23:29 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:29.372706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af2f65-0d2f-4e50-b71f-f3ca0a51dae1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:29.382895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af2f65-0d2f-4e50-b71f-f3ca0a51dae1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:29.433338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:29.442642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba41f3b-72f2-4f0d-a20c-5e9c81acbfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:29.443301 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba41f3b-72f2-4f0d-a20c-5e9c81acbfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.443580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba41f3b-72f2-4f0d-a20c-5e9c81acbfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.443902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba41f3b-72f2-4f0d-a20c-5e9c81acbfb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.444530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba41f3b-72f2-4f0d-a20c-5e9c81acbfb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:29.446565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba41f3b-72f2-4f0d-a20c-5e9c81acbfb2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:29.567622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1220/2429] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:23:29 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:29.572446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8919f4b-71d5-449e-98bf-2045e7b91e54 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:29.583419 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8919f4b-71d5-449e-98bf-2045e7b91e54 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:29.593643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d416-6885-4583-aefb-2f81b213c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:29.593643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d416-6885-4583-aefb-2f81b213c70b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.593643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d416-6885-4583-aefb-2f81b213c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.593643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d416-6885-4583-aefb-2f81b213c70b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.594295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7d416-6885-4583-aefb-2f81b213c70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:29.594295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7d416-6885-4583-aefb-2f81b213c70b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:29.605773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1210/2430] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:23:29.612903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba41f3b-72f2-4f0d-a20c-5e9c81acbfb2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:29.627997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba41f3b-72f2-4f0d-a20c-5e9c81acbfb2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:29.634583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4478b-e10c-4d1d-a320-3bc451f20cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:29.635706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4478b-e10c-4d1d-a320-3bc451f20cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.636010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4478b-e10c-4d1d-a320-3bc451f20cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.636278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4478b-e10c-4d1d-a320-3bc451f20cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.636990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4478b-e10c-4d1d-a320-3bc451f20cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:29.639162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4478b-e10c-4d1d-a320-3bc451f20cb3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:29.653467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1221/2431] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:23:29.657993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d416-6885-4583-aefb-2f81b213c70b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:29.670512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d416-6885-4583-aefb-2f81b213c70b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:29.678948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e650-2f29-4f4e-a6e5-28d5c37a079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:29.679696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e650-2f29-4f4e-a6e5-28d5c37a079e admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.680020 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e650-2f29-4f4e-a6e5-28d5c37a079e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.680298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828e650-2f29-4f4e-a6e5-28d5c37a079e admin admin] PATH_INFO: `/v3/projects/ed7a53e2e4934e1fae79730ecef51b58/users/ab554b5e130c4bee8d67f79e9f14f312/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.683455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:29.702000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828e650-2f29-4f4e-a6e5-28d5c37a079e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7a53e2e4934e1fae79730ecef51b58, user_id=ab554b5e130c4bee8d67f79e9f14f312, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:29.705832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828e650-2f29-4f4e-a6e5-28d5c37a079e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:29.841143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1211/2432] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:23:29 2022] PUT /identity/v3/projects/ed7a53e2e4934e1fae79730ecef51b58/users/ab554b5e130c4bee8d67f79e9f14f312/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:29.852671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ca3e1-7e0c-47e1-b057-3fd41f49ec6f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:29.853000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ca3e1-7e0c-47e1-b057-3fd41f49ec6f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:29.853221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ca3e1-7e0c-47e1-b057-3fd41f49ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:29.887394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7c5ca3e1-7e0c-47e1-b057-3fd41f49ec6f None None] MFA Rules not processed for user `ab554b5e130c4bee8d67f79e9f14f312`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:29.888703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7c5ca3e1-7e0c-47e1-b057-3fd41f49ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:29.975544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1222/2433] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:29.987532 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e650-2f29-4f4e-a6e5-28d5c37a079e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:29.989315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0828e650-2f29-4f4e-a6e5-28d5c37a079e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:30.051244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828e650-2f29-4f4e-a6e5-28d5c37a079e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:30.055418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbbb3b-48ad-4b2e-b7dc-5d54d204d3f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:30.055932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbbb3b-48ad-4b2e-b7dc-5d54d204d3f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:30.056212 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbbb3b-48ad-4b2e-b7dc-5d54d204d3f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:30.056483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbbb3b-48ad-4b2e-b7dc-5d54d204d3f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:30.066273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbbb3b-48ad-4b2e-b7dc-5d54d204d3f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:30.067821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbbb3b-48ad-4b2e-b7dc-5d54d204d3f5 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:30.082162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1212/2434] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:30.099721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ca3e1-7e0c-47e1-b057-3fd41f49ec6f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:30.164474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ca3e1-7e0c-47e1-b057-3fd41f49ec6f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:30.169116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:30.169803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:30.170105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:30.170378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] PATH_INFO: `/v3/users/ab554b5e130c4bee8d67f79e9f14f312` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:30.171506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab554b5e130c4bee8d67f79e9f14f312)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:30.174183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:30.453720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab554b5e130c4bee8d67f79e9f14f312'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:30.454443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab554b5e130c4bee8d67f79e9f14f312'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:30.532332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab554b5e130c4bee8d67f79e9f14f312'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:30.533148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab554b5e130c4bee8d67f79e9f14f312'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:30.541791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:30.548315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab554b5e130c4bee8d67f79e9f14f312'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:30.561024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1223/2435] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:30 2022] DELETE /identity/v3/users/ab554b5e130c4bee8d67f79e9f14f312 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:30.566051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7b30e-f651-43bc-9c11-649030baf8c5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:30.566242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7b30e-f651-43bc-9c11-649030baf8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:30.566521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7b30e-f651-43bc-9c11-649030baf8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:30.585746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d7e7b30e-f651-43bc-9c11-649030baf8c5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:30.586946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d7e7b30e-f651-43bc-9c11-649030baf8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:30.648589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1213/2436] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:30.659007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:30.660405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:30.719894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996c9a6-807f-4278-bef4-7ba81e6646ac admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:30.729591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013dd4-9621-4a0a-aecb-499900f99e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:30.730235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013dd4-9621-4a0a-aecb-499900f99e92 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:30.732209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013dd4-9621-4a0a-aecb-499900f99e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:30.732209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013dd4-9621-4a0a-aecb-499900f99e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:30.741529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93013dd4-9621-4a0a-aecb-499900f99e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:30.742947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93013dd4-9621-4a0a-aecb-499900f99e92 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:30.752858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1224/2437] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:31.239936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7b30e-f651-43bc-9c11-649030baf8c5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:31.242374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d7e7b30e-f651-43bc-9c11-649030baf8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:31.255554 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7b30e-f651-43bc-9c11-649030baf8c5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:31.260155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:31.260993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.261272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.261545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] PATH_INFO: `/v3/projects/ed7a53e2e4934e1fae79730ecef51b58` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.263042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7a53e2e4934e1fae79730ecef51b58)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:31.266013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:31.388685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7a53e2e4934e1fae79730ecef51b58', 'request_id': 'req-5b587efe-211b-450a-ade4-a3ec3c3737e2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:31.395480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7a53e2e4934e1fae79730ecef51b58', 'request_id': 'req-5b587efe-211b-450a-ade4-a3ec3c3737e2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:31.479978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7a53e2e4934e1fae79730ecef51b58', 'request_id': 'req-5b587efe-211b-450a-ade4-a3ec3c3737e2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:31.496120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] The token cache is being invalidate because project ed7a53e2e4934e1fae79730ecef51b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:31.496436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:31.498914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b587efe-211b-450a-ade4-a3ec3c3737e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:31.501652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1214/2438] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:31 2022] DELETE /identity/v3/projects/ed7a53e2e4934e1fae79730ecef51b58 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:31.506706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6dd75-30c9-4532-9329-a9a9586d0071 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.507176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6dd75-30c9-4532-9329-a9a9586d0071 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.507776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6dd75-30c9-4532-9329-a9a9586d0071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.532197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-26f6dd75-30c9-4532-9329-a9a9586d0071 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:31.533416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-26f6dd75-30c9-4532-9329-a9a9586d0071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:31.598842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1225/2439] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:31.606416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6606-db9f-423e-a155-a29af06a7cd5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.606703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6606-db9f-423e-a155-a29af06a7cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.606978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6606-db9f-423e-a155-a29af06a7cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.628272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-402e6606-db9f-423e-a155-a29af06a7cd5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:31.629607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-402e6606-db9f-423e-a155-a29af06a7cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:31.637812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1215/2440] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:31.642715 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6dd75-30c9-4532-9329-a9a9586d0071 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:31.666964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6dd75-30c9-4532-9329-a9a9586d0071 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:31.666964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724abe00-eaa3-48f8-8693-43b67f9b9c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:31.666964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724abe00-eaa3-48f8-8693-43b67f9b9c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.666964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724abe00-eaa3-48f8-8693-43b67f9b9c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.667428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724abe00-eaa3-48f8-8693-43b67f9b9c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.667428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724abe00-eaa3-48f8-8693-43b67f9b9c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:31.667428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724abe00-eaa3-48f8-8693-43b67f9b9c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:31.667428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724abe00-eaa3-48f8-8693-43b67f9b9c1a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:31.676534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1226/2441] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:31.681265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6606-db9f-423e-a155-a29af06a7cd5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:31.686555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:31.693175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6606-db9f-423e-a155-a29af06a7cd5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:31.698036 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4573503-45a5-4597-931f-7a849e57fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:31.698645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4573503-45a5-4597-931f-7a849e57fae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.698926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4573503-45a5-4597-931f-7a849e57fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.699434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4573503-45a5-4597-931f-7a849e57fae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.700116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4573503-45a5-4597-931f-7a849e57fae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:31.702356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4573503-45a5-4597-931f-7a849e57fae6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:31.805191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1216/2442] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:23:31 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:31.814192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724abe00-eaa3-48f8-8693-43b67f9b9c1a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:31.824374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724abe00-eaa3-48f8-8693-43b67f9b9c1a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:31.894817 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b112d-5bb1-4fc9-9abb-25cda18af8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:31.895485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b112d-5bb1-4fc9-9abb-25cda18af8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:31.895783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b112d-5bb1-4fc9-9abb-25cda18af8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:31.896083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b112d-5bb1-4fc9-9abb-25cda18af8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:31.902226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b112d-5bb1-4fc9-9abb-25cda18af8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:31.902226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b112d-5bb1-4fc9-9abb-25cda18af8d5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:32.023837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:32.035673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1227/2443] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:23:31 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:32.037136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4573503-45a5-4597-931f-7a849e57fae6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:32.048603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4573503-45a5-4597-931f-7a849e57fae6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:32.053834 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48f75-ff8f-46ef-a57b-3b81e5fc56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:32.054441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48f75-ff8f-46ef-a57b-3b81e5fc56a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:32.054715 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48f75-ff8f-46ef-a57b-3b81e5fc56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:32.054983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48f75-ff8f-46ef-a57b-3b81e5fc56a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:32.055625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e48f75-ff8f-46ef-a57b-3b81e5fc56a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:32.057517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e48f75-ff8f-46ef-a57b-3b81e5fc56a1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:32.075034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1217/2444] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:23:32.080041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b112d-5bb1-4fc9-9abb-25cda18af8d5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:32.090298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b112d-5bb1-4fc9-9abb-25cda18af8d5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:32.095291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b880f-ea68-4564-b9cc-57010635d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:32.095946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b880f-ea68-4564-b9cc-57010635d29b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:32.096190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b880f-ea68-4564-b9cc-57010635d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:32.096465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b880f-ea68-4564-b9cc-57010635d29b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:32.097168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b880f-ea68-4564-b9cc-57010635d29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:32.098840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b880f-ea68-4564-b9cc-57010635d29b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:32.111551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1228/2445] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:23:32.116046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48f75-ff8f-46ef-a57b-3b81e5fc56a1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:32.128189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48f75-ff8f-46ef-a57b-3b81e5fc56a1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:32.141971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0fd7-a083-4bc3-b1e5-9e8ad2370c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:32.141971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0fd7-a083-4bc3-b1e5-9e8ad2370c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:32.141971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0fd7-a083-4bc3-b1e5-9e8ad2370c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:32.141971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0fd7-a083-4bc3-b1e5-9e8ad2370c0f admin admin] PATH_INFO: `/v3/projects/92a1849640dc4478b8612310d4e1055d/users/b0a2b8b29e84445eac1498d660d0ccab/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:32.170123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed0fd7-a083-4bc3-b1e5-9e8ad2370c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a1849640dc4478b8612310d4e1055d, user_id=b0a2b8b29e84445eac1498d660d0ccab, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:32.170123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed0fd7-a083-4bc3-b1e5-9e8ad2370c0f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:32.264210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1218/2446] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:23:32 2022] PUT /identity/v3/projects/92a1849640dc4478b8612310d4e1055d/users/b0a2b8b29e84445eac1498d660d0ccab/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:23:32.282037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e35319-bdf0-4fe7-8650-3ec9e9368960 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:32.282446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e35319-bdf0-4fe7-8650-3ec9e9368960 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:32.282734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e35319-bdf0-4fe7-8650-3ec9e9368960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:32.314114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-27e35319-bdf0-4fe7-8650-3ec9e9368960 None None] MFA Rules not processed for user `b0a2b8b29e84445eac1498d660d0ccab`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:32.315399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-27e35319-bdf0-4fe7-8650-3ec9e9368960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:32.400776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1229/2447] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:23:32.421353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0fd7-a083-4bc3-b1e5-9e8ad2370c0f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:32.423935 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-95ed0fd7-a083-4bc3-b1e5-9e8ad2370c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:32.495594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0fd7-a083-4bc3-b1e5-9e8ad2370c0f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:32.499767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829950-147c-4417-9b44-322ea22bb08b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8855e3e7fc84cd9ba1afaef4cc308c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:32.502214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829950-147c-4417-9b44-322ea22bb08b service glance] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:32.502214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829950-147c-4417-9b44-322ea22bb08b service glance] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:32.502214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829950-147c-4417-9b44-322ea22bb08b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:32.511491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5829950-147c-4417-9b44-322ea22bb08b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:32.512916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5829950-147c-4417-9b44-322ea22bb08b service glance] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:32.523132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1219/2448] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:33.429354 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e9018-3102-4428-8868-41cbf1e65648 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:33.429835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e9018-3102-4428-8868-41cbf1e65648 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:33.429950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e9018-3102-4428-8868-41cbf1e65648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:33.450621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-806e9018-3102-4428-8868-41cbf1e65648 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:33.451846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-806e9018-3102-4428-8868-41cbf1e65648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:33.541799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1230/2449] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:23:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:33.600110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829950-147c-4417-9b44-322ea22bb08b service glance] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:33.601646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d5829950-147c-4417-9b44-322ea22bb08b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:33.680039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829950-147c-4417-9b44-322ea22bb08b service glance] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:33.685936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91273c89-a21d-42c3-8449-ec16aa9917a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:33.686625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91273c89-a21d-42c3-8449-ec16aa9917a8 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:33.687027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91273c89-a21d-42c3-8449-ec16aa9917a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:33.687423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91273c89-a21d-42c3-8449-ec16aa9917a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:33.696503 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91273c89-a21d-42c3-8449-ec16aa9917a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:33.698090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91273c89-a21d-42c3-8449-ec16aa9917a8 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:33.707336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1220/2450] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:23:33.977906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d256-27ca-4d72-abb3-a55a86411417 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:33.978212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d256-27ca-4d72-abb3-a55a86411417 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:33.978476 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d256-27ca-4d72-abb3-a55a86411417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:34.005622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1005d256-27ca-4d72-abb3-a55a86411417 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:34.007164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1005d256-27ca-4d72-abb3-a55a86411417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:34.034848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1231/2451] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:23:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:34.063903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91273c89-a21d-42c3-8449-ec16aa9917a8 service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:34.077221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91273c89-a21d-42c3-8449-ec16aa9917a8 service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:34.085181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22658998-385a-4861-8c42-5be20c4e5d05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:34.085985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658998-385a-4861-8c42-5be20c4e5d05 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:34.086526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658998-385a-4861-8c42-5be20c4e5d05 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:34.087118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22658998-385a-4861-8c42-5be20c4e5d05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:34.102901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22658998-385a-4861-8c42-5be20c4e5d05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:34.106142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22658998-385a-4861-8c42-5be20c4e5d05 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:34.127155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1221/2452] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:23:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:23:39.370839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d256-27ca-4d72-abb3-a55a86411417 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:39.372314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1005d256-27ca-4d72-abb3-a55a86411417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:39.549713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d256-27ca-4d72-abb3-a55a86411417 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:39.556827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:39.557830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:39.558178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:39.558784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] PATH_INFO: `/v3/users/89ae4fe1082747e58208309b2359dee8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:39.561651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ae4fe1082747e58208309b2359dee8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:39.566764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:39.613492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:39.758991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ae4fe1082747e58208309b2359dee8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:39.760043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ae4fe1082747e58208309b2359dee8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:39.817452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ae4fe1082747e58208309b2359dee8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:39.818461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ae4fe1082747e58208309b2359dee8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:39.841942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ae4fe1082747e58208309b2359dee8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:39.870427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1232/2453] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:39 2022] DELETE /identity/v3/users/89ae4fe1082747e58208309b2359dee8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:39.875346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42da970-4ed1-4867-8f59-c78c8e66cf0a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:39.879074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42da970-4ed1-4867-8f59-c78c8e66cf0a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:39.879074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42da970-4ed1-4867-8f59-c78c8e66cf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:39.944840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e42da970-4ed1-4867-8f59-c78c8e66cf0a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:39.946042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e42da970-4ed1-4867-8f59-c78c8e66cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:39.988699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:40.105392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1222/2454] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:23:40.118125 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:40.120387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:40.255195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edbd29-21d5-4a2e-84b9-e20ecbb674db admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:40.263334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f290d-15f0-41ff-9f04-f1a3edcc2eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:40.266209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f290d-15f0-41ff-9f04-f1a3edcc2eff service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:40.267690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f290d-15f0-41ff-9f04-f1a3edcc2eff service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:40.272165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f290d-15f0-41ff-9f04-f1a3edcc2eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:40.291592 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f290d-15f0-41ff-9f04-f1a3edcc2eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:40.294159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f290d-15f0-41ff-9f04-f1a3edcc2eff service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:40.320127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1233/2455] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:41.094750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42da970-4ed1-4867-8f59-c78c8e66cf0a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:41.096487 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e42da970-4ed1-4867-8f59-c78c8e66cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:41.119802 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42da970-4ed1-4867-8f59-c78c8e66cf0a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:41.128677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:41.129592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:41.130243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:41.131561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] PATH_INFO: `/v3/projects/2e6d475707fa4c20bffce332bb399da3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:41.133179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e6d475707fa4c20bffce332bb399da3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:41.137647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:41.293535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e6d475707fa4c20bffce332bb399da3', 'request_id': 'req-7c56f418-400e-422e-9a55-e384ef923762'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:41.301777 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e6d475707fa4c20bffce332bb399da3', 'request_id': 'req-7c56f418-400e-422e-9a55-e384ef923762'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:41.361359 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e6d475707fa4c20bffce332bb399da3', 'request_id': 'req-7c56f418-400e-422e-9a55-e384ef923762'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:41.401016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] The token cache is being invalidate because project 2e6d475707fa4c20bffce332bb399da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:41.401489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:41.405111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7c56f418-400e-422e-9a55-e384ef923762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:41.411484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1223/2456] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:41 2022] DELETE /identity/v3/projects/2e6d475707fa4c20bffce332bb399da3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:41.419014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417598c6-d1d1-4a16-b183-1162295e7ec2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:41.419589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417598c6-d1d1-4a16-b183-1162295e7ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:41.420111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417598c6-d1d1-4a16-b183-1162295e7ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:41.481654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-417598c6-d1d1-4a16-b183-1162295e7ec2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:41.509881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-417598c6-d1d1-4a16-b183-1162295e7ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:41.929406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1234/2457] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:41.943990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed75a-81e2-4a84-aa4c-8b7f4d357978 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:41.944600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed75a-81e2-4a84-aa4c-8b7f4d357978 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:41.945088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed75a-81e2-4a84-aa4c-8b7f4d357978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:41.998838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1b1ed75a-81e2-4a84-aa4c-8b7f4d357978 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:42.007015 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1b1ed75a-81e2-4a84-aa4c-8b7f4d357978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:42.038601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1224/2458] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:42.042524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417598c6-d1d1-4a16-b183-1162295e7ec2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:42.068990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417598c6-d1d1-4a16-b183-1162295e7ec2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:42.100240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21560a-2e86-4a77-b882-46825d5441c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:42.100977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21560a-2e86-4a77-b882-46825d5441c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:42.101333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21560a-2e86-4a77-b882-46825d5441c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:42.101702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21560a-2e86-4a77-b882-46825d5441c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:42.102457 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21560a-2e86-4a77-b882-46825d5441c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:23:42.103787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21560a-2e86-4a77-b882-46825d5441c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:42.111884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed75a-81e2-4a84-aa4c-8b7f4d357978 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:42.113460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1b1ed75a-81e2-4a84-aa4c-8b7f4d357978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:42.126007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21560a-2e86-4a77-b882-46825d5441c5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:42.130385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed75a-81e2-4a84-aa4c-8b7f4d357978 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:42.161389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:42.161998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1235/2459] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:23:42.166490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:42.166752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21560a-2e86-4a77-b882-46825d5441c5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:42.166889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:42.167143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] PATH_INFO: `/v3/users/254bd9cc471d4b75a606c849cfb201af` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:42.168562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=254bd9cc471d4b75a606c849cfb201af)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:42.170517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:42.182360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21560a-2e86-4a77-b882-46825d5441c5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:42.205313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76661d5-f892-4ef0-a944-0c21357109d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:42.209188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76661d5-f892-4ef0-a944-0c21357109d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:42.213047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76661d5-f892-4ef0-a944-0c21357109d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:42.213402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76661d5-f892-4ef0-a944-0c21357109d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:42.214100 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76661d5-f892-4ef0-a944-0c21357109d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:42.223758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76661d5-f892-4ef0-a944-0c21357109d0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:42.402208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1236/2460] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:23:42 2022] POST /identity/v3/projects => generated 397 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:42.427973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76661d5-f892-4ef0-a944-0c21357109d0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:42.451996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254bd9cc471d4b75a606c849cfb201af'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:42.452393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:42.461318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254bd9cc471d4b75a606c849cfb201af'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:42.480024 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254bd9cc471d4b75a606c849cfb201af'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:42.501289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254bd9cc471d4b75a606c849cfb201af'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:42.501289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad5d4e59-86ea-4941-8c9a-d48bfcdf70ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254bd9cc471d4b75a606c849cfb201af'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:42.520691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76661d5-f892-4ef0-a944-0c21357109d0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:42.525432 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484ebd0-9435-461d-9043-282469593ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:42.526035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484ebd0-9435-461d-9043-282469593ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:42.526315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484ebd0-9435-461d-9043-282469593ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:42.526588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484ebd0-9435-461d-9043-282469593ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:42.527217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484ebd0-9435-461d-9043-282469593ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:42.529186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484ebd0-9435-461d-9043-282469593ad7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:42.997352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1237/2461] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:23:42 2022] POST /identity/v3/users => generated 299 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:23:43.000213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1225/2462] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:42 2022] DELETE /identity/v3/users/254bd9cc471d4b75a606c849cfb201af => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:43.000731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484ebd0-9435-461d-9043-282469593ad7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:43.003946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0484ebd0-9435-461d-9043-282469593ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:43.004494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c63d5-0fb7-4177-8636-9e9ffe6471c4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:43.005344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c63d5-0fb7-4177-8636-9e9ffe6471c4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:43.005649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c63d5-0fb7-4177-8636-9e9ffe6471c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:43.017728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484ebd0-9435-461d-9043-282469593ad7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:43.026512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2e2c63d5-0fb7-4177-8636-9e9ffe6471c4 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:43.027974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2e2c63d5-0fb7-4177-8636-9e9ffe6471c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:43.037611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:43.076641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae831-88e1-4312-8f4d-ddcb1456e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:43.077316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae831-88e1-4312-8f4d-ddcb1456e1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:43.077631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae831-88e1-4312-8f4d-ddcb1456e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:43.077947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae831-88e1-4312-8f4d-ddcb1456e1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:43.079399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae831-88e1-4312-8f4d-ddcb1456e1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:43.081315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae831-88e1-4312-8f4d-ddcb1456e1b4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:43.092793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1238/2463] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:23:43.097330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae831-88e1-4312-8f4d-ddcb1456e1b4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:43.110638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae831-88e1-4312-8f4d-ddcb1456e1b4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:43.115623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb16c7c-92ce-4b47-9119-bf75a3aff36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:43.116330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb16c7c-92ce-4b47-9119-bf75a3aff36c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:43.116620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb16c7c-92ce-4b47-9119-bf75a3aff36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:43.116923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb16c7c-92ce-4b47-9119-bf75a3aff36c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:43.117613 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb16c7c-92ce-4b47-9119-bf75a3aff36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:43.119319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb16c7c-92ce-4b47-9119-bf75a3aff36c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:43.132116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1239/2464] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:23:43.136328 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb16c7c-92ce-4b47-9119-bf75a3aff36c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:43.147344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb16c7c-92ce-4b47-9119-bf75a3aff36c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:43.152270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dec3c-29ed-4bfa-b92d-ab67341f4db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:43.153047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dec3c-29ed-4bfa-b92d-ab67341f4db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:43.153544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dec3c-29ed-4bfa-b92d-ab67341f4db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:43.154029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dec3c-29ed-4bfa-b92d-ab67341f4db4 admin admin] PATH_INFO: `/v3/projects/9d985c41ebe54596820c95e7fe10c151/users/e283bafe0366464f8723a140918d7db5/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:43.177320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dec3c-29ed-4bfa-b92d-ab67341f4db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d985c41ebe54596820c95e7fe10c151, user_id=e283bafe0366464f8723a140918d7db5, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:43.180362 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dec3c-29ed-4bfa-b92d-ab67341f4db4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:43.249130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1226/2465] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:43.259592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c63d5-0fb7-4177-8636-9e9ffe6471c4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:43.260955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2e2c63d5-0fb7-4177-8636-9e9ffe6471c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:43.292761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1240/2466] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:23:43 2022] PUT /identity/v3/projects/9d985c41ebe54596820c95e7fe10c151/users/e283bafe0366464f8723a140918d7db5/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:43.305252 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a75b-ac98-4da7-9e57-e359176ce3f3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:43.306284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a75b-ac98-4da7-9e57-e359176ce3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:43.307982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a75b-ac98-4da7-9e57-e359176ce3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:43.385554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-25c3a75b-ac98-4da7-9e57-e359176ce3f3 None None] MFA Rules not processed for user `e283bafe0366464f8723a140918d7db5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:43.392348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25c3a75b-ac98-4da7-9e57-e359176ce3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:43.405305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c63d5-0fb7-4177-8636-9e9ffe6471c4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:43.502140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:43.549121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1241/2467] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:23:43.562060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a75b-ac98-4da7-9e57-e359176ce3f3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:43.565180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25c3a75b-ac98-4da7-9e57-e359176ce3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:43.645061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ae1b5-1725-49fb-8223-988edc5146ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:43.645787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae1b5-1725-49fb-8223-988edc5146ae service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:43.645976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae1b5-1725-49fb-8223-988edc5146ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:43.652434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae1b5-1725-49fb-8223-988edc5146ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:43.680892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a75b-ac98-4da7-9e57-e359176ce3f3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:43.692262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6323f47-4730-45f7-b8cb-4586ede9114d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:43.692891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6323f47-4730-45f7-b8cb-4586ede9114d service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:43.693169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6323f47-4730-45f7-b8cb-4586ede9114d service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:43.693439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6323f47-4730-45f7-b8cb-4586ede9114d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:43.716906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6323f47-4730-45f7-b8cb-4586ede9114d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:43.718948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6323f47-4730-45f7-b8cb-4586ede9114d service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:43.764130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1242/2468] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:43.850885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ae1b5-1725-49fb-8223-988edc5146ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:43.850885 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ae1b5-1725-49fb-8223-988edc5146ae service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:43.872443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1227/2469] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:23:44.717403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6323f47-4730-45f7-b8cb-4586ede9114d service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:44.727463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f6323f47-4730-45f7-b8cb-4586ede9114d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:44.764879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6323f47-4730-45f7-b8cb-4586ede9114d service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:44.788095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:44.788814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:44.789161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:44.796287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] PATH_INFO: `/v3/projects/72a1a0a34dbe4c4d91fee7cfaa1b1423` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:44.803897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a1a0a34dbe4c4d91fee7cfaa1b1423)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:44.814754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:45.048410 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a1a0a34dbe4c4d91fee7cfaa1b1423', 'request_id': 'req-ec6bc818-350d-431b-865f-67a362f703a2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:45.088636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a1a0a34dbe4c4d91fee7cfaa1b1423', 'request_id': 'req-ec6bc818-350d-431b-865f-67a362f703a2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:45.118416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a1a0a34dbe4c4d91fee7cfaa1b1423', 'request_id': 'req-ec6bc818-350d-431b-865f-67a362f703a2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:45.211924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] The token cache is being invalidate because project 72a1a0a34dbe4c4d91fee7cfaa1b1423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:45.214268 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:45.214268 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6bc818-350d-431b-865f-67a362f703a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:45.225870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1243/2470] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:44 2022] DELETE /identity/v3/projects/72a1a0a34dbe4c4d91fee7cfaa1b1423 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:51.652334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ae1b5-1725-49fb-8223-988edc5146ae service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:51.664404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ae1b5-1725-49fb-8223-988edc5146ae service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:51.691079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:51.747430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:51.748122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:51.748393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:51.748665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] PATH_INFO: `/v3/users/e283bafe0366464f8723a140918d7db5` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:51.750437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e283bafe0366464f8723a140918d7db5)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:51.752350 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:51.966388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e283bafe0366464f8723a140918d7db5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:51.978557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e283bafe0366464f8723a140918d7db5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:52.017067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e283bafe0366464f8723a140918d7db5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:52.018873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e283bafe0366464f8723a140918d7db5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:52.020140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e283bafe0366464f8723a140918d7db5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:52.139555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1228/2471] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:23:51 2022] DELETE /identity/v3/users/e283bafe0366464f8723a140918d7db5 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:23:52.140584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aec16-d4ff-4c8f-a051-c68f73a99dc9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:52.140584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aec16-d4ff-4c8f-a051-c68f73a99dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:52.140584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aec16-d4ff-4c8f-a051-c68f73a99dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:52.161944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-de2aec16-d4ff-4c8f-a051-c68f73a99dc9 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:52.163157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-de2aec16-d4ff-4c8f-a051-c68f73a99dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:52.239226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1244/2472] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:52.249075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:52.250952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:52.346874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6854c-6982-4025-b794-f616c0aef1bc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:52.350705 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c4ddb-2e08-40a8-b8a2-99030272d4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:52.351438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c4ddb-2e08-40a8-b8a2-99030272d4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:52.351722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c4ddb-2e08-40a8-b8a2-99030272d4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:52.352040 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c4ddb-2e08-40a8-b8a2-99030272d4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:52.362759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c4ddb-2e08-40a8-b8a2-99030272d4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:52.364377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c4ddb-2e08-40a8-b8a2-99030272d4e6 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:52.376656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1229/2473] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:53.072430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aec16-d4ff-4c8f-a051-c68f73a99dc9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:53.074965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-de2aec16-d4ff-4c8f-a051-c68f73a99dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:53.100662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aec16-d4ff-4c8f-a051-c68f73a99dc9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:53.107754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:53.109474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:53.109897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:53.110570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] PATH_INFO: `/v3/projects/9d985c41ebe54596820c95e7fe10c151` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:53.112536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d985c41ebe54596820c95e7fe10c151)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:53.115473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:53.125612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:53.302066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d985c41ebe54596820c95e7fe10c151', 'request_id': 'req-050476f2-cb39-4b3d-aa06-1f6d013bad09'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:53.314760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d985c41ebe54596820c95e7fe10c151', 'request_id': 'req-050476f2-cb39-4b3d-aa06-1f6d013bad09'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:53.328576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d985c41ebe54596820c95e7fe10c151', 'request_id': 'req-050476f2-cb39-4b3d-aa06-1f6d013bad09'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:53.399838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] The token cache is being invalidate because project 9d985c41ebe54596820c95e7fe10c151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:23:53.403411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:53.403411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-050476f2-cb39-4b3d-aa06-1f6d013bad09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:23:53.403411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1245/2474] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:23:53 2022] DELETE /identity/v3/projects/9d985c41ebe54596820c95e7fe10c151 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:23:55.864293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c4ddb-2e08-40a8-b8a2-99030272d4e6 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:55.866486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a38c4ddb-2e08-40a8-b8a2-99030272d4e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:55.921916 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:23:55.948162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c4ddb-2e08-40a8-b8a2-99030272d4e6 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:56.038693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:56.039307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:56.039600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:56.039899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:56.041662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:56.054737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:56.056497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:56.068157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1230/2475] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:23:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:23:59.011065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba26fe-9bf0-4937-a43c-98f993b95c5e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:59.011593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba26fe-9bf0-4937-a43c-98f993b95c5e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:59.011735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba26fe-9bf0-4937-a43c-98f993b95c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:59.033470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2fba26fe-9bf0-4937-a43c-98f993b95c5e None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:59.034702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2fba26fe-9bf0-4937-a43c-98f993b95c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:59.097453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1246/2476] 10.222.0.13 () {58 vars in 967 bytes} [Wed Aug 31 11:23:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:23:59.112045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:23:59.113560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:59.198775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343f6e3-49d6-4f0a-8047-0451eb0bbb5a service placement] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:23:59.204146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03d996-75b7-44d0-8864-12f20e6802d7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:59.204583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03d996-75b7-44d0-8864-12f20e6802d7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:59.204869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03d996-75b7-44d0-8864-12f20e6802d7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:59.206487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1247/2477] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:23:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:23:59.208781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d205df-a5ae-468a-8aa5-367b37b35591 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:23:59.209498 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d205df-a5ae-468a-8aa5-367b37b35591 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:59.209872 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d205df-a5ae-468a-8aa5-367b37b35591 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:59.210210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d205df-a5ae-468a-8aa5-367b37b35591 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:59.212729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c58e-ab9a-45ab-86df-054992dc6a13 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:23:59.213043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c58e-ab9a-45ab-86df-054992dc6a13 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:23:59.213414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c58e-ab9a-45ab-86df-054992dc6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:23:59.223110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d205df-a5ae-468a-8aa5-367b37b35591 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:23:59.226123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d205df-a5ae-468a-8aa5-367b37b35591 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:23:59.237795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1231/2478] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:23:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:23:59.239111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e9f2c58e-ab9a-45ab-86df-054992dc6a13 None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:23:59.241290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e9f2c58e-ab9a-45ab-86df-054992dc6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:23:59.317760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1248/2479] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:23:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:24:00.641159 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d205df-a5ae-468a-8aa5-367b37b35591 service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:00.643113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-03d205df-a5ae-468a-8aa5-367b37b35591 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:00.701706 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d205df-a5ae-468a-8aa5-367b37b35591 service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:00.705693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a306541-1c34-44ec-ac5c-e8c143952370 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8855e3e7fc84cd9ba1afaef4cc308c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:00.706291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a306541-1c34-44ec-ac5c-e8c143952370 service glance] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:00.706609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a306541-1c34-44ec-ac5c-e8c143952370 service glance] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:00.706874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a306541-1c34-44ec-ac5c-e8c143952370 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:00.719464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a306541-1c34-44ec-ac5c-e8c143952370 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:00.720938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a306541-1c34-44ec-ac5c-e8c143952370 service glance] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:00.732222 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1232/2480] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:24:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:24:00.961660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eebf2-cecb-4e63-9efd-87c766b88141 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:00.962203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eebf2-cecb-4e63-9efd-87c766b88141 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:00.962203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eebf2-cecb-4e63-9efd-87c766b88141 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:00.963708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1249/2481] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:24:00.969160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb916d-84fc-454a-a638-97f837cf621c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:00.969528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb916d-84fc-454a-a638-97f837cf621c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:00.969823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb916d-84fc-454a-a638-97f837cf621c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:00.984275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:00.990585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-00fb916d-84fc-454a-a638-97f837cf621c None None] MFA Rules not processed for user `041de16601f342c1a9b18003773a0856`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:00.991823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-00fb916d-84fc-454a-a638-97f837cf621c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:01.045778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1233/2482] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:24:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:24:01.058370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eebf2-cecb-4e63-9efd-87c766b88141 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:01.060285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-812eebf2-cecb-4e63-9efd-87c766b88141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:01.073960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eebf2-cecb-4e63-9efd-87c766b88141 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:01.078690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8baf-1e0b-4af4-a5db-43f1dff1e003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:01.079471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8baf-1e0b-4af4-a5db-43f1dff1e003 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:01.080013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8baf-1e0b-4af4-a5db-43f1dff1e003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:01.080413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8baf-1e0b-4af4-a5db-43f1dff1e003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:01.088633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8baf-1e0b-4af4-a5db-43f1dff1e003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:01.090327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8baf-1e0b-4af4-a5db-43f1dff1e003 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:01.099593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1250/2483] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:24:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:24:01.186925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62426669-5e7d-4ba7-bf19-863f76b300b0 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:01.187230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62426669-5e7d-4ba7-bf19-863f76b300b0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:01.187729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62426669-5e7d-4ba7-bf19-863f76b300b0 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:01.189134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1234/2484] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:24:01.194664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bef5-77e8-4746-9b5e-755fbb5b51dc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:01.194948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bef5-77e8-4746-9b5e-755fbb5b51dc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:01.195225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bef5-77e8-4746-9b5e-755fbb5b51dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:01.216376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-74d6bef5-77e8-4746-9b5e-755fbb5b51dc None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:01.217742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-74d6bef5-77e8-4746-9b5e-755fbb5b51dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:01.234641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1251/2485] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:24:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:01.245884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62426669-5e7d-4ba7-bf19-863f76b300b0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:01.247637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-62426669-5e7d-4ba7-bf19-863f76b300b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:01.262958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62426669-5e7d-4ba7-bf19-863f76b300b0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:01.268164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e92666-ab07-4404-979f-e2ebe36ab592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:01.268164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e92666-ab07-4404-979f-e2ebe36ab592 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:01.268447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e92666-ab07-4404-979f-e2ebe36ab592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:01.268686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e92666-ab07-4404-979f-e2ebe36ab592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:01.284099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e92666-ab07-4404-979f-e2ebe36ab592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:01.285582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e92666-ab07-4404-979f-e2ebe36ab592 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:01.297080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1235/2486] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:24:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:24:02.661522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6bef5-77e8-4746-9b5e-755fbb5b51dc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:02.663092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-74d6bef5-77e8-4746-9b5e-755fbb5b51dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:02.678093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:02.735882 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6bef5-77e8-4746-9b5e-755fbb5b51dc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:02.741192 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:02.741920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:02.742193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:02.742463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] PATH_INFO: `/v3/users/422f027c14884f5384f2ed2ff68c82f8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:02.743645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422f027c14884f5384f2ed2ff68c82f8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:02.745771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:02.944638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422f027c14884f5384f2ed2ff68c82f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:02.945207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422f027c14884f5384f2ed2ff68c82f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:03.016588 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422f027c14884f5384f2ed2ff68c82f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:03.017199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422f027c14884f5384f2ed2ff68c82f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:03.029655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d6ab3769-a4b1-48e1-84e5-4e18503dbf35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422f027c14884f5384f2ed2ff68c82f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:03.042414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1252/2487] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:24:02 2022] DELETE /identity/v3/users/422f027c14884f5384f2ed2ff68c82f8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:24:03.297477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e92666-ab07-4404-979f-e2ebe36ab592 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:03.308631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e92666-ab07-4404-979f-e2ebe36ab592 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:03.366621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:03.367255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:03.367537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:03.367850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] PATH_INFO: `/v3/projects/cd5007cbd4704bcf8238b0379b286710` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:03.368992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5007cbd4704bcf8238b0379b286710)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:03.370925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:03.480172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5007cbd4704bcf8238b0379b286710', 'request_id': 'req-5982f66a-e969-4e6c-87b5-3ef98df4bc72'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:03.487255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5007cbd4704bcf8238b0379b286710', 'request_id': 'req-5982f66a-e969-4e6c-87b5-3ef98df4bc72'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:03.565301 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5007cbd4704bcf8238b0379b286710', 'request_id': 'req-5982f66a-e969-4e6c-87b5-3ef98df4bc72'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:03.576387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] The token cache is being invalidate because project cd5007cbd4704bcf8238b0379b286710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:24:03.576680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:03.577391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5982f66a-e969-4e6c-87b5-3ef98df4bc72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:03.578906 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1236/2488] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:24:03 2022] DELETE /identity/v3/projects/cd5007cbd4704bcf8238b0379b286710 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:24:03.584622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df3a3-7184-49b1-a259-243d802afc88 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:03.584911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df3a3-7184-49b1-a259-243d802afc88 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:03.585186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df3a3-7184-49b1-a259-243d802afc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:03.605336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c95df3a3-7184-49b1-a259-243d802afc88 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:03.608437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c95df3a3-7184-49b1-a259-243d802afc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:03.667614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1253/2489] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:03.676363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73e45f-47ad-479c-9c5b-286a0ecbcac2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:03.676650 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73e45f-47ad-479c-9c5b-286a0ecbcac2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:03.676928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73e45f-47ad-479c-9c5b-286a0ecbcac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:03.696971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ed73e45f-47ad-479c-9c5b-286a0ecbcac2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:03.698181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ed73e45f-47ad-479c-9c5b-286a0ecbcac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:03.706617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1237/2490] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:03.711117 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95df3a3-7184-49b1-a259-243d802afc88 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:03.721612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95df3a3-7184-49b1-a259-243d802afc88 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:03.726208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8bd0-5e9c-4aea-93ca-7897329141fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:03.726808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8bd0-5e9c-4aea-93ca-7897329141fd admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:03.727085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8bd0-5e9c-4aea-93ca-7897329141fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:03.727355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8bd0-5e9c-4aea-93ca-7897329141fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:03.728035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a8bd0-5e9c-4aea-93ca-7897329141fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:03.728336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a8bd0-5e9c-4aea-93ca-7897329141fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:03.730010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a8bd0-5e9c-4aea-93ca-7897329141fd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:03.745670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1254/2491] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:24:03.757869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73e45f-47ad-479c-9c5b-286a0ecbcac2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:03.765955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73e45f-47ad-479c-9c5b-286a0ecbcac2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:03.773505 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62213d-bb32-4d53-9cae-7c155d2d7a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:03.774273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62213d-bb32-4d53-9cae-7c155d2d7a48 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:03.774655 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62213d-bb32-4d53-9cae-7c155d2d7a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:03.775063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62213d-bb32-4d53-9cae-7c155d2d7a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:03.776384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62213d-bb32-4d53-9cae-7c155d2d7a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:03.778550 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62213d-bb32-4d53-9cae-7c155d2d7a48 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:03.893818 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1238/2492] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:24:03 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:24:03.893956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8bd0-5e9c-4aea-93ca-7897329141fd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:03.907293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8bd0-5e9c-4aea-93ca-7897329141fd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:03.922110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:03.978696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca62e-951e-4155-9fe5-ac5c24486d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:03.979453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca62e-951e-4155-9fe5-ac5c24486d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:03.979859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca62e-951e-4155-9fe5-ac5c24486d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:03.980202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca62e-951e-4155-9fe5-ac5c24486d19 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:03.981111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ca62e-951e-4155-9fe5-ac5c24486d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:03.986373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ca62e-951e-4155-9fe5-ac5c24486d19 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:04.070654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1255/2493] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:24:03 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:24:04.075143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62213d-bb32-4d53-9cae-7c155d2d7a48 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:04.082829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:04.088724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62213d-bb32-4d53-9cae-7c155d2d7a48 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:04.094702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef97b1c-d966-4b91-8a7c-6a19d94d80c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:04.095312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef97b1c-d966-4b91-8a7c-6a19d94d80c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:04.095597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef97b1c-d966-4b91-8a7c-6a19d94d80c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:04.096002 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef97b1c-d966-4b91-8a7c-6a19d94d80c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:04.096688 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef97b1c-d966-4b91-8a7c-6a19d94d80c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:04.098295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef97b1c-d966-4b91-8a7c-6a19d94d80c1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:04.110043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1239/2494] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:24:04.114271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca62e-951e-4155-9fe5-ac5c24486d19 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:04.125427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca62e-951e-4155-9fe5-ac5c24486d19 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:04.130315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1898fa-c235-4757-95d0-cebbcbae307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:04.130927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1898fa-c235-4757-95d0-cebbcbae307e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:04.131204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1898fa-c235-4757-95d0-cebbcbae307e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:04.131473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1898fa-c235-4757-95d0-cebbcbae307e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:04.132157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1898fa-c235-4757-95d0-cebbcbae307e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:04.133787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1898fa-c235-4757-95d0-cebbcbae307e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:04.147498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1256/2495] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:24:04.151661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef97b1c-d966-4b91-8a7c-6a19d94d80c1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:04.163223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef97b1c-d966-4b91-8a7c-6a19d94d80c1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:04.168209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fabc9-2b4f-474e-b685-97686a9a7fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:04.168878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fabc9-2b4f-474e-b685-97686a9a7fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:04.169154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fabc9-2b4f-474e-b685-97686a9a7fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:04.169424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fabc9-2b4f-474e-b685-97686a9a7fb9 admin admin] PATH_INFO: `/v3/projects/37457c6c02ec432fb8578b4f40b10f84/users/ecd6829f8c4f45e8846100e05d2368d3/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:04.184962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fabc9-2b4f-474e-b685-97686a9a7fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37457c6c02ec432fb8578b4f40b10f84, user_id=ecd6829f8c4f45e8846100e05d2368d3, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:04.187667 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fabc9-2b4f-474e-b685-97686a9a7fb9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:04.248225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1240/2496] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:24:04 2022] PUT /identity/v3/projects/37457c6c02ec432fb8578b4f40b10f84/users/ecd6829f8c4f45e8846100e05d2368d3/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:24:04.257872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223e4dd-ae7f-403e-a8c8-5e4c9bda2279 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:04.258171 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223e4dd-ae7f-403e-a8c8-5e4c9bda2279 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:04.258439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223e4dd-ae7f-403e-a8c8-5e4c9bda2279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:04.291931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e223e4dd-ae7f-403e-a8c8-5e4c9bda2279 None None] MFA Rules not processed for user `ecd6829f8c4f45e8846100e05d2368d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:04.293189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e223e4dd-ae7f-403e-a8c8-5e4c9bda2279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:04.368494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1257/2497] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:04.379157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fabc9-2b4f-474e-b685-97686a9a7fb9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:04.380871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0c2fabc9-2b4f-474e-b685-97686a9a7fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:04.441268 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fabc9-2b4f-474e-b685-97686a9a7fb9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:04.445541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6210-b657-4aa6-a28a-54b0c8e33413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:04.446239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6210-b657-4aa6-a28a-54b0c8e33413 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:04.446682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6210-b657-4aa6-a28a-54b0c8e33413 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:04.447045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6210-b657-4aa6-a28a-54b0c8e33413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:04.456429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f6210-b657-4aa6-a28a-54b0c8e33413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:04.457956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f6210-b657-4aa6-a28a-54b0c8e33413 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:04.466959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1241/2498] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:24:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:24:05.291384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1db1e-2bab-4d20-8466-253b10e62977 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:05.291888 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1db1e-2bab-4d20-8466-253b10e62977 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:05.292028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1db1e-2bab-4d20-8466-253b10e62977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:05.312802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a3b1db1e-2bab-4d20-8466-253b10e62977 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:05.314253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a3b1db1e-2bab-4d20-8466-253b10e62977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:05.370037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1258/2499] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:24:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:05.382035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6210-b657-4aa6-a28a-54b0c8e33413 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:05.383464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-373f6210-b657-4aa6-a28a-54b0c8e33413 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:05.454266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6210-b657-4aa6-a28a-54b0c8e33413 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:05.459548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934a1ad-ca9a-47c2-aff2-6c0e42cb16c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:05.460221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934a1ad-ca9a-47c2-aff2-6c0e42cb16c1 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:05.460494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934a1ad-ca9a-47c2-aff2-6c0e42cb16c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:05.460798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934a1ad-ca9a-47c2-aff2-6c0e42cb16c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:05.470392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934a1ad-ca9a-47c2-aff2-6c0e42cb16c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:05.472189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934a1ad-ca9a-47c2-aff2-6c0e42cb16c1 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:05.480009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1242/2500] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 11:24:07.293647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266627-a408-4a58-bfac-eafe4bee309b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:07.294199 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266627-a408-4a58-bfac-eafe4bee309b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:07.294869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70266627-a408-4a58-bfac-eafe4bee309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:07.317287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-70266627-a408-4a58-bfac-eafe4bee309b None None] MFA Rules not processed for user `ecd6829f8c4f45e8846100e05d2368d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:07.328256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-70266627-a408-4a58-bfac-eafe4bee309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:07.351157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1259/2501] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:15.476844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:17.309310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:25.921121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934a1ad-ca9a-47c2-aff2-6c0e42cb16c1 service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:25.923177 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9934a1ad-ca9a-47c2-aff2-6c0e42cb16c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:25.990228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934a1ad-ca9a-47c2-aff2-6c0e42cb16c1 service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:25.994625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:25.995248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:25.995527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:25.995827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] PATH_INFO: `/v3/users/b0a2b8b29e84445eac1498d660d0ccab` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:25.996945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a2b8b29e84445eac1498d660d0ccab)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:25.998902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:26.158093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a2b8b29e84445eac1498d660d0ccab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:26.171910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a2b8b29e84445eac1498d660d0ccab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:26.198378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a2b8b29e84445eac1498d660d0ccab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:26.199250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a2b8b29e84445eac1498d660d0ccab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:26.199930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a2b8b29e84445eac1498d660d0ccab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:26.293378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1243/2502] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:24:25 2022] DELETE /identity/v3/users/b0a2b8b29e84445eac1498d660d0ccab => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:24:26.295013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28cb5-b4c0-4319-849e-cc4a18ce6918 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:26.295501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28cb5-b4c0-4319-849e-cc4a18ce6918 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:26.295679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28cb5-b4c0-4319-849e-cc4a18ce6918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:26.321019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-53a28cb5-b4c0-4319-849e-cc4a18ce6918 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:26.322355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-53a28cb5-b4c0-4319-849e-cc4a18ce6918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:26.382141 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1260/2503] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:26.391566 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:26.393529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:26.451648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40aeeb-f77e-4b1b-9744-937c9977e456 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:26.455864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeedb06-4fc7-469c-87f8-933126a07e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:26.456462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeedb06-4fc7-469c-87f8-933126a07e96 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:26.456732 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeedb06-4fc7-469c-87f8-933126a07e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:26.456996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeedb06-4fc7-469c-87f8-933126a07e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:26.466106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeedb06-4fc7-469c-87f8-933126a07e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:26.467544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeedb06-4fc7-469c-87f8-933126a07e96 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:26.477839 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1244/2504] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:24:26.972934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a28cb5-b4c0-4319-849e-cc4a18ce6918 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:26.975707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-53a28cb5-b4c0-4319-849e-cc4a18ce6918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:26.987871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a28cb5-b4c0-4319-849e-cc4a18ce6918 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:26.993074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:26.993714 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:26.993994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:26.994416 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] PATH_INFO: `/v3/projects/92a1849640dc4478b8612310d4e1055d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:26.995679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a1849640dc4478b8612310d4e1055d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:26.997727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:27.099344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a1849640dc4478b8612310d4e1055d', 'request_id': 'req-a15bf6b4-302a-4800-9933-d35d76e5a0b2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:27.106653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a1849640dc4478b8612310d4e1055d', 'request_id': 'req-a15bf6b4-302a-4800-9933-d35d76e5a0b2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:27.114402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a1849640dc4478b8612310d4e1055d', 'request_id': 'req-a15bf6b4-302a-4800-9933-d35d76e5a0b2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:27.180274 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] The token cache is being invalidate because project 92a1849640dc4478b8612310d4e1055d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:24:27.180562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:27.181202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a15bf6b4-302a-4800-9933-d35d76e5a0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:27.183237 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1261/2505] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:24:26 2022] DELETE /identity/v3/projects/92a1849640dc4478b8612310d4e1055d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:24:27.187974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72b39-5ded-439d-a980-13136cad3927 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:27.188454 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72b39-5ded-439d-a980-13136cad3927 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:27.188661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc72b39-5ded-439d-a980-13136cad3927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:27.208968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0bc72b39-5ded-439d-a980-13136cad3927 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:27.210172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0bc72b39-5ded-439d-a980-13136cad3927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:27.227479 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:27.272397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1245/2506] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:27.280170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ea547-8aed-48ef-8704-14a0272c9e21 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:27.280449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ea547-8aed-48ef-8704-14a0272c9e21 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:27.280835 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ea547-8aed-48ef-8704-14a0272c9e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:27.301201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-865ea547-8aed-48ef-8704-14a0272c9e21 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:27.302402 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-865ea547-8aed-48ef-8704-14a0272c9e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:27.310556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1262/2507] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:27.315622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72b39-5ded-439d-a980-13136cad3927 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:27.325428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc72b39-5ded-439d-a980-13136cad3927 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:27.330316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a8a1e-6a21-4eae-a04d-2a67e8f5eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:27.331138 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a8a1e-6a21-4eae-a04d-2a67e8f5eca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:27.331412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a8a1e-6a21-4eae-a04d-2a67e8f5eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:27.331681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a8a1e-6a21-4eae-a04d-2a67e8f5eca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:27.332357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a8a1e-6a21-4eae-a04d-2a67e8f5eca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:24:27.332738 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a8a1e-6a21-4eae-a04d-2a67e8f5eca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:27.334408 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a8a1e-6a21-4eae-a04d-2a67e8f5eca6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:27.347538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1246/2508] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:24:27.351626 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ea547-8aed-48ef-8704-14a0272c9e21 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:27.360791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ea547-8aed-48ef-8704-14a0272c9e21 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:27.366297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeadc72-8d73-4ba1-ac8b-e8c2fd54b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:27.367100 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeadc72-8d73-4ba1-ac8b-e8c2fd54b0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:27.367374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeadc72-8d73-4ba1-ac8b-e8c2fd54b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:27.367643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeadc72-8d73-4ba1-ac8b-e8c2fd54b0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:27.368314 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeadc72-8d73-4ba1-ac8b-e8c2fd54b0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:27.370415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeadc72-8d73-4ba1-ac8b-e8c2fd54b0dd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:27.495948 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1263/2509] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:24:27 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:24:27.507709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a8a1e-6a21-4eae-a04d-2a67e8f5eca6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:27.518892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a8a1e-6a21-4eae-a04d-2a67e8f5eca6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:27.580556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cb112-9c4f-4af9-9f7c-ee44ee1cbd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:27.581249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cb112-9c4f-4af9-9f7c-ee44ee1cbd83 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:27.581538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cb112-9c4f-4af9-9f7c-ee44ee1cbd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:27.581814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cb112-9c4f-4af9-9f7c-ee44ee1cbd83 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:27.582519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cb112-9c4f-4af9-9f7c-ee44ee1cbd83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:27.584499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cb112-9c4f-4af9-9f7c-ee44ee1cbd83 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:27.681151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1247/2510] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:24:27 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:24:27.685435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeadc72-8d73-4ba1-ac8b-e8c2fd54b0dd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:27.696147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeadc72-8d73-4ba1-ac8b-e8c2fd54b0dd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:27.700783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48854c8-eca7-4004-b59d-1d058ddea234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:27.701435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48854c8-eca7-4004-b59d-1d058ddea234 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:27.701709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48854c8-eca7-4004-b59d-1d058ddea234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:27.701983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48854c8-eca7-4004-b59d-1d058ddea234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:27.703254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48854c8-eca7-4004-b59d-1d058ddea234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:27.704929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48854c8-eca7-4004-b59d-1d058ddea234 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:27.717284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1264/2511] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:24:27.721778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cb112-9c4f-4af9-9f7c-ee44ee1cbd83 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:27.732153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cb112-9c4f-4af9-9f7c-ee44ee1cbd83 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:27.737450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c84f4-9d16-483f-ade5-01bb75a39fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:27.738127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c84f4-9d16-483f-ade5-01bb75a39fab admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:27.738411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c84f4-9d16-483f-ade5-01bb75a39fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:27.738684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c84f4-9d16-483f-ade5-01bb75a39fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:27.739328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c84f4-9d16-483f-ade5-01bb75a39fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:27.740947 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c84f4-9d16-483f-ade5-01bb75a39fab admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:27.751497 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1248/2512] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:24:27.755664 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48854c8-eca7-4004-b59d-1d058ddea234 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:27.765612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48854c8-eca7-4004-b59d-1d058ddea234 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:27.770315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac28e0-0d81-4c8d-9922-96f66792be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:27.770956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac28e0-0d81-4c8d-9922-96f66792be8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:27.771228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac28e0-0d81-4c8d-9922-96f66792be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:27.771497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac28e0-0d81-4c8d-9922-96f66792be8b admin admin] PATH_INFO: `/v3/projects/b4aabfd3beee4713ba62aaf719ff4916/users/121aeeadf49e4538a2cb5cc5125c79f8/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:27.786858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac28e0-0d81-4c8d-9922-96f66792be8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4aabfd3beee4713ba62aaf719ff4916, user_id=121aeeadf49e4538a2cb5cc5125c79f8, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:27.791915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac28e0-0d81-4c8d-9922-96f66792be8b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:27.873673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1265/2513] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:24:27 2022] PUT /identity/v3/projects/b4aabfd3beee4713ba62aaf719ff4916/users/121aeeadf49e4538a2cb5cc5125c79f8/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:24:27.884050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdbe2b-667e-49da-a612-7e94262ced50 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:27.884342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdbe2b-667e-49da-a612-7e94262ced50 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:27.884620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdbe2b-667e-49da-a612-7e94262ced50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:27.917037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-37cdbe2b-667e-49da-a612-7e94262ced50 None None] MFA Rules not processed for user `121aeeadf49e4538a2cb5cc5125c79f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:27.917037 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-37cdbe2b-667e-49da-a612-7e94262ced50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:27.987346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1249/2514] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:27.998947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac28e0-0d81-4c8d-9922-96f66792be8b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:28.000752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dfac28e0-0d81-4c8d-9922-96f66792be8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:28.029654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:28.095001 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac28e0-0d81-4c8d-9922-96f66792be8b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:28.100306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f32f8-755e-46b6-856d-f8c2db83d2d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:28.100925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f32f8-755e-46b6-856d-f8c2db83d2d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:28.104007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f32f8-755e-46b6-856d-f8c2db83d2d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:28.104007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f32f8-755e-46b6-856d-f8c2db83d2d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:28.110259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f32f8-755e-46b6-856d-f8c2db83d2d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:28.111783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f32f8-755e-46b6-856d-f8c2db83d2d3 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:28.120774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1266/2515] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:24:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:24:30.751934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd019220-32eb-4e66-8fe5-7b81f6e88e66 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:30.752899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd019220-32eb-4e66-8fe5-7b81f6e88e66 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:30.753179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd019220-32eb-4e66-8fe5-7b81f6e88e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:30.781389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-dd019220-32eb-4e66-8fe5-7b81f6e88e66 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:30.782631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-dd019220-32eb-4e66-8fe5-7b81f6e88e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:30.795425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:30.838192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1250/2516] 10.222.0.13 () {58 vars in 967 bytes} [Wed Aug 31 11:24:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:24:30.851068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f32f8-755e-46b6-856d-f8c2db83d2d3 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:30.852486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-926f32f8-755e-46b6-856d-f8c2db83d2d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:30.922348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f32f8-755e-46b6-856d-f8c2db83d2d3 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:30.927563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3337d-7ee1-456f-adab-a82ad9ef1954 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:30.928207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3337d-7ee1-456f-adab-a82ad9ef1954 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:30.928486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3337d-7ee1-456f-adab-a82ad9ef1954 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:30.928757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3337d-7ee1-456f-adab-a82ad9ef1954 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:30.937075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3337d-7ee1-456f-adab-a82ad9ef1954 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:30.938686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3337d-7ee1-456f-adab-a82ad9ef1954 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:30.946795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1267/2517] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:24:40.934401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=17 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:40.943514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=49 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:43.158139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d1979-6482-4ba9-8244-64aa887f91f4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:43.158645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d1979-6482-4ba9-8244-64aa887f91f4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:43.158744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d1979-6482-4ba9-8244-64aa887f91f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:43.179005 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9f0d1979-6482-4ba9-8244-64aa887f91f4 None None] MFA Rules not processed for user `ef569b9142a14d4e924af8692e75065a`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:43.180236 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9f0d1979-6482-4ba9-8244-64aa887f91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:43.234382 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1251/2518] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:46.614198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360ddf0-8dd2-4026-a01f-05753c534b24 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:46.614712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360ddf0-8dd2-4026-a01f-05753c534b24 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:46.614712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360ddf0-8dd2-4026-a01f-05753c534b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:46.635859 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c360ddf0-8dd2-4026-a01f-05753c534b24 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:46.637149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c360ddf0-8dd2-4026-a01f-05753c534b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:46.644804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1268/2519] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:24:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:46.667496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d1979-6482-4ba9-8244-64aa887f91f4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:46.679352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d1979-6482-4ba9-8244-64aa887f91f4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:46.684756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5dada-3585-42ef-b71a-df7970986f4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:46.685377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5dada-3585-42ef-b71a-df7970986f4f service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:46.685654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5dada-3585-42ef-b71a-df7970986f4f service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:46.685924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5dada-3585-42ef-b71a-df7970986f4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:46.694082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5dada-3585-42ef-b71a-df7970986f4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:46.695686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5dada-3585-42ef-b71a-df7970986f4f service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:46.703580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1252/2520] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:24:47.834304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243483f4-6263-4b40-9506-bb6ae4c861a1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:47.834782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243483f4-6263-4b40-9506-bb6ae4c861a1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:47.834879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243483f4-6263-4b40-9506-bb6ae4c861a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:47.854774 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-243483f4-6263-4b40-9506-bb6ae4c861a1 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:47.855762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-243483f4-6263-4b40-9506-bb6ae4c861a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:47.865952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1269/2521] 10.222.0.13 () {58 vars in 967 bytes} [Wed Aug 31 11:24:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:47.876954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5dada-3585-42ef-b71a-df7970986f4f service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:47.887669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5dada-3585-42ef-b71a-df7970986f4f service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:47.893911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70ba6d-b19e-402d-ac84-310b150415ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:47.895451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70ba6d-b19e-402d-ac84-310b150415ef service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:47.895734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70ba6d-b19e-402d-ac84-310b150415ef service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:47.896213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70ba6d-b19e-402d-ac84-310b150415ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:47.905284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70ba6d-b19e-402d-ac84-310b150415ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:47.907294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70ba6d-b19e-402d-ac84-310b150415ef service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:47.931475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1253/2522] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:24:48.730509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569bffc-5ef0-41ac-856f-06f48d9f2c31 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:48.731235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569bffc-5ef0-41ac-856f-06f48d9f2c31 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:48.731696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569bffc-5ef0-41ac-856f-06f48d9f2c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:48.766694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7569bffc-5ef0-41ac-856f-06f48d9f2c31 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:48.767953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7569bffc-5ef0-41ac-856f-06f48d9f2c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:48.775446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1270/2523] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:24:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:48.787913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70ba6d-b19e-402d-ac84-310b150415ef service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:48.798492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70ba6d-b19e-402d-ac84-310b150415ef service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:48.804535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5691dd4-f1e8-4a40-a6fc-361a41930d3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:48.805160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5691dd4-f1e8-4a40-a6fc-361a41930d3e service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:48.805489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5691dd4-f1e8-4a40-a6fc-361a41930d3e service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:48.805747 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5691dd4-f1e8-4a40-a6fc-361a41930d3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:48.815177 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5691dd4-f1e8-4a40-a6fc-361a41930d3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:48.816824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5691dd4-f1e8-4a40-a6fc-361a41930d3e service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:48.826384 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1254/2524] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:24:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:24:49.520971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd64f5-81af-4bad-9072-90f346a90bfd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:49.522057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd64f5-81af-4bad-9072-90f346a90bfd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:49.522057 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd64f5-81af-4bad-9072-90f346a90bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:49.541884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e0bd64f5-81af-4bad-9072-90f346a90bfd None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:49.543114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e0bd64f5-81af-4bad-9072-90f346a90bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:49.550304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1271/2525] 10.222.0.13 () {58 vars in 967 bytes} [Wed Aug 31 11:24:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:49.563669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5691dd4-f1e8-4a40-a6fc-361a41930d3e service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:49.580278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5691dd4-f1e8-4a40-a6fc-361a41930d3e service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:49.585517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcd131-b551-4350-a526-49a9d7d51b37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:49.586118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcd131-b551-4350-a526-49a9d7d51b37 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:49.586388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcd131-b551-4350-a526-49a9d7d51b37 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:49.586653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcd131-b551-4350-a526-49a9d7d51b37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:49.595577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcd131-b551-4350-a526-49a9d7d51b37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:49.597293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcd131-b551-4350-a526-49a9d7d51b37 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:49.606216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1255/2526] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:24:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:24:52.563497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd64f5-81af-4bad-9072-90f346a90bfd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:52.564972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e0bd64f5-81af-4bad-9072-90f346a90bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:52.630047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd64f5-81af-4bad-9072-90f346a90bfd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:52.635044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:52.635667 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:52.635972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:52.636244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] PATH_INFO: `/v3/users/ecd6829f8c4f45e8846100e05d2368d3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:52.637368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd6829f8c4f45e8846100e05d2368d3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:52.639275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:52.805522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd6829f8c4f45e8846100e05d2368d3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:52.806243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd6829f8c4f45e8846100e05d2368d3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:52.871556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd6829f8c4f45e8846100e05d2368d3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:52.872214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd6829f8c4f45e8846100e05d2368d3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:52.886398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd6829f8c4f45e8846100e05d2368d3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:52.898953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1272/2527] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:24:52 2022] DELETE /identity/v3/users/ecd6829f8c4f45e8846100e05d2368d3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:24:52.903630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee96c-d3b8-4aeb-9db4-4602991b46d4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:52.904172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee96c-d3b8-4aeb-9db4-4602991b46d4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:52.904285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ee96c-d3b8-4aeb-9db4-4602991b46d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:52.924734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-879ee96c-d3b8-4aeb-9db4-4602991b46d4 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:24:52.925937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-879ee96c-d3b8-4aeb-9db4-4602991b46d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:52.988156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1256/2528] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:24:52.999546 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:53.001063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:53.061390 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbe494-2f3a-4deb-9d16-1e0379e07f71 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:53.066105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9e840-9b62-41f2-b4d0-48315ff8e840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:53.066746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9e840-9b62-41f2-b4d0-48315ff8e840 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:53.067130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9e840-9b62-41f2-b4d0-48315ff8e840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:53.067502 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9e840-9b62-41f2-b4d0-48315ff8e840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:53.075946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:53.078298 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9e840-9b62-41f2-b4d0-48315ff8e840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:53.079795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9e840-9b62-41f2-b4d0-48315ff8e840 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:53.089408 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1273/2529] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:24:53.322174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee96c-d3b8-4aeb-9db4-4602991b46d4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:24:53.322556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-879ee96c-d3b8-4aeb-9db4-4602991b46d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:24:53.335165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ee96c-d3b8-4aeb-9db4-4602991b46d4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:24:53.341557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:24:53.342320 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:24:53.342482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:24:53.342752 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] PATH_INFO: `/v3/projects/37457c6c02ec432fb8578b4f40b10f84` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:24:53.344102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37457c6c02ec432fb8578b4f40b10f84)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:24:53.346057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:24:53.504256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:24:53.506401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37457c6c02ec432fb8578b4f40b10f84', 'request_id': 'req-25e1a889-c53e-473c-ab52-fc0741023fb8'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:53.512771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37457c6c02ec432fb8578b4f40b10f84', 'request_id': 'req-25e1a889-c53e-473c-ab52-fc0741023fb8'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:53.616682 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37457c6c02ec432fb8578b4f40b10f84', 'request_id': 'req-25e1a889-c53e-473c-ab52-fc0741023fb8'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:53.628161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] The token cache is being invalidate because project 37457c6c02ec432fb8578b4f40b10f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:24:53.634447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:53.634447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-25e1a889-c53e-473c-ab52-fc0741023fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:24:53.634447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1257/2530] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:24:53 2022] DELETE /identity/v3/projects/37457c6c02ec432fb8578b4f40b10f84 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:25:03.198817 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:03.629835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:17.507176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9e840-9b62-41f2-b4d0-48315ff8e840 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:17.508768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9da9e840-9b62-41f2-b4d0-48315ff8e840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:17.521569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9e840-9b62-41f2-b4d0-48315ff8e840 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:17.576557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:17.577190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:17.577453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:17.577725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] PATH_INFO: `/v3/users/121aeeadf49e4538a2cb5cc5125c79f8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:17.578845 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=121aeeadf49e4538a2cb5cc5125c79f8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:17.580847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:17.778172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121aeeadf49e4538a2cb5cc5125c79f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:17.778821 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121aeeadf49e4538a2cb5cc5125c79f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:17.850417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121aeeadf49e4538a2cb5cc5125c79f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:17.850970 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121aeeadf49e4538a2cb5cc5125c79f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:17.863677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121aeeadf49e4538a2cb5cc5125c79f8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:17.875488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1274/2531] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:25:17 2022] DELETE /identity/v3/users/121aeeadf49e4538a2cb5cc5125c79f8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:25:17.879949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f07ae-9f95-4a2f-98a0-f88baeebb50c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:17.880431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f07ae-9f95-4a2f-98a0-f88baeebb50c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:17.880534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f07ae-9f95-4a2f-98a0-f88baeebb50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:17.901730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d39f07ae-9f95-4a2f-98a0-f88baeebb50c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:25:17.902933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d39f07ae-9f95-4a2f-98a0-f88baeebb50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:17.960473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1258/2532] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:25:17.971074 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:17.972515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:18.029869 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be67bff-4fe1-47a2-bfc7-8220cb43f2ac admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:18.033531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f76d8-5129-4b6f-82c9-8767b099302c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:18.034126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f76d8-5129-4b6f-82c9-8767b099302c service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:18.034398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f76d8-5129-4b6f-82c9-8767b099302c service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:18.034665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f76d8-5129-4b6f-82c9-8767b099302c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:18.043582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f76d8-5129-4b6f-82c9-8767b099302c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:18.045046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f76d8-5129-4b6f-82c9-8767b099302c service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:18.054253 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1275/2533] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:25:18.489526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f07ae-9f95-4a2f-98a0-f88baeebb50c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:18.491052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d39f07ae-9f95-4a2f-98a0-f88baeebb50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:18.503691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f07ae-9f95-4a2f-98a0-f88baeebb50c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:18.508427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:18.510509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:18.510789 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:18.511060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] PATH_INFO: `/v3/projects/b4aabfd3beee4713ba62aaf719ff4916` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:18.512271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4aabfd3beee4713ba62aaf719ff4916)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:18.514154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:18.639128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4aabfd3beee4713ba62aaf719ff4916', 'request_id': 'req-358e5226-35ec-4cb4-8cfd-5293e821ee77'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:18.645203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4aabfd3beee4713ba62aaf719ff4916', 'request_id': 'req-358e5226-35ec-4cb4-8cfd-5293e821ee77'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:18.736082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4aabfd3beee4713ba62aaf719ff4916', 'request_id': 'req-358e5226-35ec-4cb4-8cfd-5293e821ee77'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:18.747095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] The token cache is being invalidate because project b4aabfd3beee4713ba62aaf719ff4916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:25:18.747401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:18.748043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:25:18.749508 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1259/2534] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:25:18 2022] DELETE /identity/v3/projects/b4aabfd3beee4713ba62aaf719ff4916 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:25:28.050235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:28.744531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:52.059707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f76d8-5129-4b6f-82c9-8767b099302c service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:52.061111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b28f76d8-5129-4b6f-82c9-8767b099302c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:52.118237 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f76d8-5129-4b6f-82c9-8767b099302c service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:52.166126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:52.166722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:52.167000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:52.167272 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:52.169020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:52.237504 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:52.238922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:52.249924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1276/2535] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:25:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:25:52.750803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:52.752391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:52.764735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e5226-35ec-4cb4-8cfd-5293e821ee77 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:52.768302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41381973-833e-4650-a51b-b9e6ba1c9dd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:52.768891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41381973-833e-4650-a51b-b9e6ba1c9dd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:52.769207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41381973-833e-4650-a51b-b9e6ba1c9dd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:52.769477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41381973-833e-4650-a51b-b9e6ba1c9dd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:52.771129 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-41381973-833e-4650-a51b-b9e6ba1c9dd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:52.831547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41381973-833e-4650-a51b-b9e6ba1c9dd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:52.847893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41381973-833e-4650-a51b-b9e6ba1c9dd8 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:52.847893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1260/2536] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:25:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:25:55.186289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:25:55.187824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:55.243756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedb54b-b8d2-457e-a238-baf983de0187 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:25:55.247466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bb09a-d77e-465d-8a86-646b9efcf5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:25:55.248078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bb09a-d77e-465d-8a86-646b9efcf5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:25:55.248353 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bb09a-d77e-465d-8a86-646b9efcf5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:25:55.248621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bb09a-d77e-465d-8a86-646b9efcf5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:25:55.250388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-643bb09a-d77e-465d-8a86-646b9efcf5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:25:55.264676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bb09a-d77e-465d-8a86-646b9efcf5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:25:55.266185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bb09a-d77e-465d-8a86-646b9efcf5f9 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:25:55.272075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:25:55.277239 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1277/2537] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:25:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:02.837811 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=28 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:03.263908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67758545-6d04-4255-b56c-ca913fb48820 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:03.264198 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67758545-6d04-4255-b56c-ca913fb48820 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:03.264474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67758545-6d04-4255-b56c-ca913fb48820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:03.287800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-67758545-6d04-4255-b56c-ca913fb48820 None None] MFA Rules not processed for user `713abcb6fbc1425a83aa794243ea93d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:03.287800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-67758545-6d04-4255-b56c-ca913fb48820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:03.292388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1261/2538] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:26:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:03.596949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bb09a-d77e-465d-8a86-646b9efcf5f9 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:03.605436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bb09a-d77e-465d-8a86-646b9efcf5f9 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:03.609028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:03.609658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:03.609940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:03.610441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:03.612628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:03.622697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:03.624161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:03.632206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1278/2539] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:04.080354 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67758545-6d04-4255-b56c-ca913fb48820 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:04.081954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-67758545-6d04-4255-b56c-ca913fb48820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:04.164166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67758545-6d04-4255-b56c-ca913fb48820 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:04.169140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:04.169871 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:04.170150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:04.170428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:04.172665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:04.184496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:04.186104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:04.196647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1262/2540] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:07.372708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:07.374829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:07.386827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829af83-181d-4dba-8994-84f86be95ea4 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:07.391997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2576f49-d376-47d4-ad21-3f7fedd4ac71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:07.392681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2576f49-d376-47d4-ad21-3f7fedd4ac71 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:07.393159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2576f49-d376-47d4-ad21-3f7fedd4ac71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:07.393503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2576f49-d376-47d4-ad21-3f7fedd4ac71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:07.395518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d2576f49-d376-47d4-ad21-3f7fedd4ac71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:07.406694 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2576f49-d376-47d4-ad21-3f7fedd4ac71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:07.408388 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2576f49-d376-47d4-ad21-3f7fedd4ac71 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:07.420087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1279/2541] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:08.460192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:08.462460 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:08.480838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e219e-bbe3-47ee-b2bd-58e3f75be31b service placement] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:08.487262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:08.487913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:08.488389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:08.488819 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:08.490794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:08.505281 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:08.507052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:08.519513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1263/2542] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:17.416181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=12 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:18.513573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=41 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:21.749553 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565f4c7-01aa-4439-a92a-151acaa9b941 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:21.750073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565f4c7-01aa-4439-a92a-151acaa9b941 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:21.750991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565f4c7-01aa-4439-a92a-151acaa9b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:21.772722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c565f4c7-01aa-4439-a92a-151acaa9b941 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:21.775286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c565f4c7-01aa-4439-a92a-151acaa9b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:21.832269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1280/2543] 10.222.0.13 () {58 vars in 967 bytes} [Wed Aug 31 11:26:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:21.977226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:21.978713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:22.049173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbb20-8cb3-469c-877a-57f514cf237e service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:22.054399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928ceac-eb8b-4cb9-8939-2c6b70affba5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:22.055141 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928ceac-eb8b-4cb9-8939-2c6b70affba5 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:22.055418 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928ceac-eb8b-4cb9-8939-2c6b70affba5 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:22.055689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928ceac-eb8b-4cb9-8939-2c6b70affba5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:22.064436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928ceac-eb8b-4cb9-8939-2c6b70affba5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:22.066079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928ceac-eb8b-4cb9-8939-2c6b70affba5 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:22.074072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1264/2544] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:26:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:26:26.837334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565f4c7-01aa-4439-a92a-151acaa9b941 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:26.838888 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c565f4c7-01aa-4439-a92a-151acaa9b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:26.854322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565f4c7-01aa-4439-a92a-151acaa9b941 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:26.859499 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:26.860378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:26.860716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:26.861054 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:26.862828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:26.874617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:26.876303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:26.886832 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1281/2545] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:30.648272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928ceac-eb8b-4cb9-8939-2c6b70affba5 service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:30.663185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928ceac-eb8b-4cb9-8939-2c6b70affba5 service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:30.668848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5551c-0815-4f35-94c7-ca5dd548d4c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:30.669450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5551c-0815-4f35-94c7-ca5dd548d4c9 service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:30.669726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5551c-0815-4f35-94c7-ca5dd548d4c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:30.669997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5551c-0815-4f35-94c7-ca5dd548d4c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:30.671733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7ff5551c-0815-4f35-94c7-ca5dd548d4c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:30.684729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5551c-0815-4f35-94c7-ca5dd548d4c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:30.686352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5551c-0815-4f35-94c7-ca5dd548d4c9 service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:30.697058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1265/2546] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:30.788400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:30.788400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:30.854905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a0d5b-04db-483c-aa5d-5f2217f436e2 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:30.860625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:30.861414 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:30.861685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:30.861953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] PATH_INFO: `/v3/users/58a762e958144f0bb9cf0a9ab5a91032` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:30.863221 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a762e958144f0bb9cf0a9ab5a91032)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:30.865429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:31.097544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a762e958144f0bb9cf0a9ab5a91032'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.098196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a762e958144f0bb9cf0a9ab5a91032'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.169170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a762e958144f0bb9cf0a9ab5a91032'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.169785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a762e958144f0bb9cf0a9ab5a91032'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.182419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a762e958144f0bb9cf0a9ab5a91032'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.195555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1282/2547] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:26:30 2022] DELETE /identity/v3/users/58a762e958144f0bb9cf0a9ab5a91032 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:26:31.445708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5551c-0815-4f35-94c7-ca5dd548d4c9 service placement] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:31.458363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5551c-0815-4f35-94c7-ca5dd548d4c9 service placement] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:31.515533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:31.516238 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:31.517022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:31.517298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] PATH_INFO: `/v3/projects/3959681d128b4073b597793bc224f819` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:31.518421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3959681d128b4073b597793bc224f819)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:31.520357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:31.694064 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3959681d128b4073b597793bc224f819', 'request_id': 'req-194832f1-7947-434b-8d50-7cf3139b9a92'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.700209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3959681d128b4073b597793bc224f819', 'request_id': 'req-194832f1-7947-434b-8d50-7cf3139b9a92'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.772248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3959681d128b4073b597793bc224f819', 'request_id': 'req-194832f1-7947-434b-8d50-7cf3139b9a92'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.783023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] The token cache is being invalidate because project 3959681d128b4073b597793bc224f819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:26:31.783307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.783975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:31.785506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1266/2548] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:26:31 2022] DELETE /identity/v3/projects/3959681d128b4073b597793bc224f819 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:26:31.789475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:31.790864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:31.804490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120808-5c27-4761-b068-6dbbcf171191 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:31.812732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:31.864891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:31.865518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:31.865790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:31.866058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] PATH_INFO: `/v3/users/e1e3509323f34441a2b9d9b39dddaa61` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:31.867172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e3509323f34441a2b9d9b39dddaa61)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:31.869146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:32.072132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e3509323f34441a2b9d9b39dddaa61'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.072789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e3509323f34441a2b9d9b39dddaa61'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.146633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e3509323f34441a2b9d9b39dddaa61'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.147334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e3509323f34441a2b9d9b39dddaa61'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.162929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e3509323f34441a2b9d9b39dddaa61'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.177972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1283/2549] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:26:31 2022] DELETE /identity/v3/users/e1e3509323f34441a2b9d9b39dddaa61 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:26:32.186476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:32.187930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:32.198837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:32.248666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194832f1-7947-434b-8d50-7cf3139b9a92 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:32.296759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e4746-3c41-454d-92e1-9b3049c37b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:32.297367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e4746-3c41-454d-92e1-9b3049c37b87 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:32.297790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e4746-3c41-454d-92e1-9b3049c37b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:32.298107 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e4746-3c41-454d-92e1-9b3049c37b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:32.299882 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-203e4746-3c41-454d-92e1-9b3049c37b87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:32.365850 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e4746-3c41-454d-92e1-9b3049c37b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:32.367191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e4746-3c41-454d-92e1-9b3049c37b87 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:32.377023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1267/2550] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:32.622791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:32.624451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:32.647973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f5af4-db43-48b0-870a-5f8e7c389122 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:32.654372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:32.654372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:32.655126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:32.655126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] PATH_INFO: `/v3/projects/a71f0a772e554303b4c3c964626e1061` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:32.656460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71f0a772e554303b4c3c964626e1061)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:32.659163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:32.780971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71f0a772e554303b4c3c964626e1061', 'request_id': 'req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.788482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71f0a772e554303b4c3c964626e1061', 'request_id': 'req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.794364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71f0a772e554303b4c3c964626e1061', 'request_id': 'req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.889368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] The token cache is being invalidate because project a71f0a772e554303b4c3c964626e1061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:26:32.889578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.890197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5a73bf71-82f1-4323-bcd1-8e9c49bc9031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:26:32.891728 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1284/2551] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:26:32 2022] DELETE /identity/v3/projects/a71f0a772e554303b4c3c964626e1061 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:26:32.896746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988594ec-45cd-4302-ba13-c44d2befbcde None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:32.897216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988594ec-45cd-4302-ba13-c44d2befbcde None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:32.897792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988594ec-45cd-4302-ba13-c44d2befbcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:32.918124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-988594ec-45cd-4302-ba13-c44d2befbcde None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:32.919317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-988594ec-45cd-4302-ba13-c44d2befbcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:32.979211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1268/2552] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:26:32.987972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155fd8d-4f88-45b4-a5fc-76c17bb31119 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:32.988282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155fd8d-4f88-45b4-a5fc-76c17bb31119 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:32.988607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155fd8d-4f88-45b4-a5fc-76c17bb31119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:33.008608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2155fd8d-4f88-45b4-a5fc-76c17bb31119 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:33.009968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2155fd8d-4f88-45b4-a5fc-76c17bb31119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:33.019086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1285/2553] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:33.024341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988594ec-45cd-4302-ba13-c44d2befbcde None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:33.034791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988594ec-45cd-4302-ba13-c44d2befbcde None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:33.039325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853e3ed-4f99-41b9-9938-c2f24678dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:33.040099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853e3ed-4f99-41b9-9938-c2f24678dab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:33.040376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853e3ed-4f99-41b9-9938-c2f24678dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:33.040647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853e3ed-4f99-41b9-9938-c2f24678dab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:33.041318 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853e3ed-4f99-41b9-9938-c2f24678dab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:26:33.041620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853e3ed-4f99-41b9-9938-c2f24678dab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:33.043373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853e3ed-4f99-41b9-9938-c2f24678dab9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:33.052175 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:33.055457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1269/2554] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:26:33.060112 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155fd8d-4f88-45b4-a5fc-76c17bb31119 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:33.069419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155fd8d-4f88-45b4-a5fc-76c17bb31119 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:33.075182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421b73-44fe-4452-acde-840bc24ec109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:33.075182 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421b73-44fe-4452-acde-840bc24ec109 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:33.075527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421b73-44fe-4452-acde-840bc24ec109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:33.075527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421b73-44fe-4452-acde-840bc24ec109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:33.076178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64421b73-44fe-4452-acde-840bc24ec109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:33.078096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64421b73-44fe-4452-acde-840bc24ec109 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:33.083198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:33.188306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1286/2555] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:26:33 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:26:33.192398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853e3ed-4f99-41b9-9938-c2f24678dab9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:33.202431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853e3ed-4f99-41b9-9938-c2f24678dab9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:33.260176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bdf8c-c006-4e9c-9b42-43d10d0459b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:33.260823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bdf8c-c006-4e9c-9b42-43d10d0459b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:33.261100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bdf8c-c006-4e9c-9b42-43d10d0459b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:33.261370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bdf8c-c006-4e9c-9b42-43d10d0459b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:33.262058 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bdf8c-c006-4e9c-9b42-43d10d0459b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:33.264030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bdf8c-c006-4e9c-9b42-43d10d0459b6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:33.359289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1270/2556] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:26:33 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:26:33.363512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421b73-44fe-4452-acde-840bc24ec109 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:33.374051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421b73-44fe-4452-acde-840bc24ec109 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:33.378680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d246ff-f73d-4f30-83ee-2be4165c284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:33.379283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d246ff-f73d-4f30-83ee-2be4165c284c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:33.379584 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d246ff-f73d-4f30-83ee-2be4165c284c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:33.379849 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d246ff-f73d-4f30-83ee-2be4165c284c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:33.380516 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d246ff-f73d-4f30-83ee-2be4165c284c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:33.382119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d246ff-f73d-4f30-83ee-2be4165c284c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:33.393379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1287/2557] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:26:33.397697 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bdf8c-c006-4e9c-9b42-43d10d0459b6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:33.408838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bdf8c-c006-4e9c-9b42-43d10d0459b6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:33.414045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d400a-473f-43b9-80da-356e864264e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:33.414730 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d400a-473f-43b9-80da-356e864264e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:33.415135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d400a-473f-43b9-80da-356e864264e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:33.415449 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d400a-473f-43b9-80da-356e864264e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:33.416277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d400a-473f-43b9-80da-356e864264e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:33.417851 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d400a-473f-43b9-80da-356e864264e2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:33.429827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1271/2558] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:26:33.433938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d246ff-f73d-4f30-83ee-2be4165c284c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:33.444574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d246ff-f73d-4f30-83ee-2be4165c284c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:33.449137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77235b2b-e708-403e-90e5-de74630c1d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:33.449775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77235b2b-e708-403e-90e5-de74630c1d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:33.450050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77235b2b-e708-403e-90e5-de74630c1d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:33.450316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77235b2b-e708-403e-90e5-de74630c1d68 admin admin] PATH_INFO: `/v3/projects/2ab5fbab225448ed8aca54a931186f2c/users/32373b6ee59d46e0bf693c1e34995172/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:33.464755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77235b2b-e708-403e-90e5-de74630c1d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab5fbab225448ed8aca54a931186f2c, user_id=32373b6ee59d46e0bf693c1e34995172, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:33.467475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77235b2b-e708-403e-90e5-de74630c1d68 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:33.553922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1288/2559] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:26:33 2022] PUT /identity/v3/projects/2ab5fbab225448ed8aca54a931186f2c/users/32373b6ee59d46e0bf693c1e34995172/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:26:33.559952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb65bc0-a215-4676-8c2b-71073b427be0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:33.560233 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb65bc0-a215-4676-8c2b-71073b427be0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:33.560492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb65bc0-a215-4676-8c2b-71073b427be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:33.581262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6fb65bc0-a215-4676-8c2b-71073b427be0 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:33.582478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6fb65bc0-a215-4676-8c2b-71073b427be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:33.644962 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1272/2560] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:33.654800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77235b2b-e708-403e-90e5-de74630c1d68 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:33.656535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-77235b2b-e708-403e-90e5-de74630c1d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:33.714885 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77235b2b-e708-403e-90e5-de74630c1d68 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:33.719334 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da49bc-ac63-4d4a-bfd0-41394eef3c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:33.719965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da49bc-ac63-4d4a-bfd0-41394eef3c32 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:33.720243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da49bc-ac63-4d4a-bfd0-41394eef3c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:33.720512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da49bc-ac63-4d4a-bfd0-41394eef3c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:33.730461 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da49bc-ac63-4d4a-bfd0-41394eef3c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:33.733990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da49bc-ac63-4d4a-bfd0-41394eef3c32 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:33.742679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1289/2561] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:26:39.754825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f055cd3-faf5-4197-af74-2c9bfdd386fd None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:39.755360 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f055cd3-faf5-4197-af74-2c9bfdd386fd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:39.755360 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f055cd3-faf5-4197-af74-2c9bfdd386fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:39.786267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3f055cd3-faf5-4197-af74-2c9bfdd386fd None None] MFA Rules not processed for user `32373b6ee59d46e0bf693c1e34995172`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:39.787593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3f055cd3-faf5-4197-af74-2c9bfdd386fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:39.864366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1273/2562] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:26:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:39.869124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da49bc-ac63-4d4a-bfd0-41394eef3c32 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:39.881213 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da49bc-ac63-4d4a-bfd0-41394eef3c32 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:39.888733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb2a00-a450-41ea-93d5-5f70c28d11cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:39.889422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb2a00-a450-41ea-93d5-5f70c28d11cc admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:39.889767 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb2a00-a450-41ea-93d5-5f70c28d11cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:39.890104 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb2a00-a450-41ea-93d5-5f70c28d11cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:39.890860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb2a00-a450-41ea-93d5-5f70c28d11cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:39.893965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb2a00-a450-41ea-93d5-5f70c28d11cc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:40.003819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1290/2563] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:26:39 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:26:40.008809 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f055cd3-faf5-4197-af74-2c9bfdd386fd None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:40.022671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f055cd3-faf5-4197-af74-2c9bfdd386fd None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:40.029286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:40.098997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8baec1-0de2-4f0a-8e16-4ba0f50f3862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:40.100260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8baec1-0de2-4f0a-8e16-4ba0f50f3862 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:40.100566 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8baec1-0de2-4f0a-8e16-4ba0f50f3862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:40.101027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8baec1-0de2-4f0a-8e16-4ba0f50f3862 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:40.101704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8baec1-0de2-4f0a-8e16-4ba0f50f3862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:40.103662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8baec1-0de2-4f0a-8e16-4ba0f50f3862 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:40.249961 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1274/2564] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:26:40 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:26:40.254524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb2a00-a450-41ea-93d5-5f70c28d11cc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:40.265695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb2a00-a450-41ea-93d5-5f70c28d11cc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:40.271984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecd1b6-d5ca-4add-ad14-94d44009a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:40.277563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd1b6-d5ca-4add-ad14-94d44009a81a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:40.277563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd1b6-d5ca-4add-ad14-94d44009a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:40.277563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd1b6-d5ca-4add-ad14-94d44009a81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:40.277563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecd1b6-d5ca-4add-ad14-94d44009a81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:40.277563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecd1b6-d5ca-4add-ad14-94d44009a81a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:40.291047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1291/2565] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:26:40.292196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8baec1-0de2-4f0a-8e16-4ba0f50f3862 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:40.304622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8baec1-0de2-4f0a-8e16-4ba0f50f3862 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:40.309668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754b7ab-4a42-4981-a185-d2bd5b0efe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:40.310376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754b7ab-4a42-4981-a185-d2bd5b0efe41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:40.310695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754b7ab-4a42-4981-a185-d2bd5b0efe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:40.311092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754b7ab-4a42-4981-a185-d2bd5b0efe41 admin admin] PATH_INFO: `/v3/projects/debb1e62c7524c45bdbe8fe7e4d58c1a/users/b3f991f98e0a4fd7a7de22752d6df0ee/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:40.332431 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754b7ab-4a42-4981-a185-d2bd5b0efe41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debb1e62c7524c45bdbe8fe7e4d58c1a, user_id=b3f991f98e0a4fd7a7de22752d6df0ee, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:40.335270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754b7ab-4a42-4981-a185-d2bd5b0efe41 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:40.464933 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1275/2566] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:26:40 2022] PUT /identity/v3/projects/debb1e62c7524c45bdbe8fe7e4d58c1a/users/b3f991f98e0a4fd7a7de22752d6df0ee/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:26:40.469103 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecd1b6-d5ca-4add-ad14-94d44009a81a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:40.480016 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecd1b6-d5ca-4add-ad14-94d44009a81a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:40.560643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efec605-daac-40ff-8186-43cda7e495ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:40.561308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efec605-daac-40ff-8186-43cda7e495ed admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:40.561533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efec605-daac-40ff-8186-43cda7e495ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:40.561805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efec605-daac-40ff-8186-43cda7e495ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:40.562451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efec605-daac-40ff-8186-43cda7e495ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:40.564438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efec605-daac-40ff-8186-43cda7e495ed admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:40.575085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1292/2567] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:26:40.579282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754b7ab-4a42-4981-a185-d2bd5b0efe41 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:40.589973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754b7ab-4a42-4981-a185-d2bd5b0efe41 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:40.595133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412a838-295c-4277-950d-f0cd9b8ede14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:40.595812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412a838-295c-4277-950d-f0cd9b8ede14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:40.596086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412a838-295c-4277-950d-f0cd9b8ede14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:40.596352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412a838-295c-4277-950d-f0cd9b8ede14 admin admin] PATH_INFO: `/v3/projects/debb1e62c7524c45bdbe8fe7e4d58c1a/users/b3f991f98e0a4fd7a7de22752d6df0ee/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:40.598274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412a838-295c-4277-950d-f0cd9b8ede14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debb1e62c7524c45bdbe8fe7e4d58c1a, user_id=b3f991f98e0a4fd7a7de22752d6df0ee, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:40.600929 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412a838-295c-4277-950d-f0cd9b8ede14 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:40.615816 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1276/2568] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:26:40 2022] PUT /identity/v3/projects/debb1e62c7524c45bdbe8fe7e4d58c1a/users/b3f991f98e0a4fd7a7de22752d6df0ee/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:26:46.700864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc115e-b5db-44df-82ca-a0d76540105e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:46.701423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc115e-b5db-44df-82ca-a0d76540105e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:46.701423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc115e-b5db-44df-82ca-a0d76540105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:46.731606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-49bc115e-b5db-44df-82ca-a0d76540105e None None] MFA Rules not processed for user `b3f991f98e0a4fd7a7de22752d6df0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:46.732779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-49bc115e-b5db-44df-82ca-a0d76540105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:46.737203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:46.815792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1293/2569] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:46.829331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412a838-295c-4277-950d-f0cd9b8ede14 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:26:46.831133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0412a838-295c-4277-950d-f0cd9b8ede14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:46.908717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412a838-295c-4277-950d-f0cd9b8ede14 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:26:46.914322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314e523-e93f-4fd0-8611-2ae8a55d3ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:26:46.914993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e523-e93f-4fd0-8611-2ae8a55d3ce4 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:46.915274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e523-e93f-4fd0-8611-2ae8a55d3ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:46.915551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e523-e93f-4fd0-8611-2ae8a55d3ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:46.977027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314e523-e93f-4fd0-8611-2ae8a55d3ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:26:46.978675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314e523-e93f-4fd0-8611-2ae8a55d3ce4 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:26:46.982830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:26:46.989946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1277/2570] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:26:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:26:50.180825 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fef5b6-0b5e-4fbf-b327-c31c41bd14f2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:50.181727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fef5b6-0b5e-4fbf-b327-c31c41bd14f2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:50.182173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fef5b6-0b5e-4fbf-b327-c31c41bd14f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:50.205772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e0fef5b6-0b5e-4fbf-b327-c31c41bd14f2 None None] MFA Rules not processed for user `32373b6ee59d46e0bf693c1e34995172`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:50.207126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e0fef5b6-0b5e-4fbf-b327-c31c41bd14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:50.214518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1294/2571] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:26:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:26:55.914656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369182c-52a6-4454-85d2-5aded93b5885 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:26:55.923215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369182c-52a6-4454-85d2-5aded93b5885 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:26:55.923215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369182c-52a6-4454-85d2-5aded93b5885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:26:55.935054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f369182c-52a6-4454-85d2-5aded93b5885 None None] MFA Rules not processed for user `ef569b9142a14d4e924af8692e75065a`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:26:55.936306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f369182c-52a6-4454-85d2-5aded93b5885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:26:55.999242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1278/2572] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:26:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:27:00.199271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=30 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:02.605658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fef5b6-0b5e-4fbf-b327-c31c41bd14f2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:02.608059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e0fef5b6-0b5e-4fbf-b327-c31c41bd14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:02.626257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fef5b6-0b5e-4fbf-b327-c31c41bd14f2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:02.631960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:02.632572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:02.632851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:02.633110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:02.635467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:02.648866 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:02.650455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:02.662033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1295/2573] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:05.992450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=26 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:12.656561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:27.659106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369182c-52a6-4454-85d2-5aded93b5885 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:27.672529 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369182c-52a6-4454-85d2-5aded93b5885 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:27.678908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:27.679612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:27.680515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:27.680515 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:27.682219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:27.694878 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:27.696506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:27.706957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1279/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:30.936625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:27:30.938085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:27:30.995070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ef8e0-ee78-482f-b808-852632c2f4e0 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:27:30.998693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912b4c6-f974-4cb9-93e3-b854400f92b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:27:30.999321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912b4c6-f974-4cb9-93e3-b854400f92b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:27:30.999598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912b4c6-f974-4cb9-93e3-b854400f92b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:27:30.999902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912b4c6-f974-4cb9-93e3-b854400f92b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:27:31.009609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912b4c6-f974-4cb9-93e3-b854400f92b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:27:31.011049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912b4c6-f974-4cb9-93e3-b854400f92b8 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:27:31.021118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1296/2575] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:27:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:27:37.702376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:27:41.016275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=26 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:07.181849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:07.183351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:07.239630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540f0a5-d893-4396-a231-fb8d03c2df6f service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:07.243788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:07.244410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:07.244663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:07.244926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:07.246640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:07.257627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:07.259708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:07.268555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1280/2576] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:10.141025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29254be-26c3-4945-9e58-2ad1f6aecfc9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:10.141509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29254be-26c3-4945-9e58-2ad1f6aecfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:10.141601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29254be-26c3-4945-9e58-2ad1f6aecfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:10.160871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b29254be-26c3-4945-9e58-2ad1f6aecfc9 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:10.162067 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b29254be-26c3-4945-9e58-2ad1f6aecfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:10.219343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1297/2577] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:28:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:10.373186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:10.374717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:10.449926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8f06f-630b-4d84-a7c8-d09b0a7bb666 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:10.455026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0f4e2-eadd-422f-9f47-877a60f78b0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:10.455626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0f4e2-eadd-422f-9f47-877a60f78b0a service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:10.455937 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0f4e2-eadd-422f-9f47-877a60f78b0a service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:10.456291 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0f4e2-eadd-422f-9f47-877a60f78b0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:10.466496 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0f4e2-eadd-422f-9f47-877a60f78b0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:10.468237 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0f4e2-eadd-422f-9f47-877a60f78b0a service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:10.478194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1281/2578] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:28:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:28:20.213123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=25 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:20.473280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=58 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:30.044796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90204208-9344-4e83-8138-689d1f2ebc2f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:30.045493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90204208-9344-4e83-8138-689d1f2ebc2f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:30.045493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90204208-9344-4e83-8138-689d1f2ebc2f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:30.046712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1298/2579] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:30.052720 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c13ec-ca24-4756-97b1-5e84270515ad None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:30.053204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c13ec-ca24-4756-97b1-5e84270515ad None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:30.053328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c13ec-ca24-4756-97b1-5e84270515ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:30.076063 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-305c13ec-ca24-4756-97b1-5e84270515ad None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:30.077395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-305c13ec-ca24-4756-97b1-5e84270515ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:30.086917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1282/2580] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:28:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:30.103285 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90204208-9344-4e83-8138-689d1f2ebc2f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:30.106114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-90204208-9344-4e83-8138-689d1f2ebc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:30.175241 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90204208-9344-4e83-8138-689d1f2ebc2f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:30.178834 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e72da-6954-4ed9-ae76-834417f1ad0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8855e3e7fc84cd9ba1afaef4cc308c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:30.179450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e72da-6954-4ed9-ae76-834417f1ad0b service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:30.179725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e72da-6954-4ed9-ae76-834417f1ad0b service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:30.180022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e72da-6954-4ed9-ae76-834417f1ad0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:30.192180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e72da-6954-4ed9-ae76-834417f1ad0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:30.193775 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e72da-6954-4ed9-ae76-834417f1ad0b service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:30.206896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1299/2581] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:30.426326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeaf64-c4b4-4c99-bf91-458691e56627 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:30.426608 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeaf64-c4b4-4c99-bf91-458691e56627 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:30.426883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeaf64-c4b4-4c99-bf91-458691e56627 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:30.428266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1283/2582] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:30.433846 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e1675-df82-4ab0-853b-eb4aadcdb50b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:30.434131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e1675-df82-4ab0-853b-eb4aadcdb50b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:30.434404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e1675-df82-4ab0-853b-eb4aadcdb50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:30.455138 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ae7e1675-df82-4ab0-853b-eb4aadcdb50b None None] MFA Rules not processed for user `041de16601f342c1a9b18003773a0856`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:30.456286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae7e1675-df82-4ab0-853b-eb4aadcdb50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:30.463718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1300/2583] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:28:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:30.475335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeaf64-c4b4-4c99-bf91-458691e56627 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:30.487157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeaf64-c4b4-4c99-bf91-458691e56627 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:30.490896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7564c-e810-4faf-9c6e-4a0b03916bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:30.491486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7564c-e810-4faf-9c6e-4a0b03916bca service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:30.491792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7564c-e810-4faf-9c6e-4a0b03916bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:30.492070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7564c-e810-4faf-9c6e-4a0b03916bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:30.499733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7564c-e810-4faf-9c6e-4a0b03916bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:30.501296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7564c-e810-4faf-9c6e-4a0b03916bca service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:30.509186 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1284/2584] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:30.617491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65fbb-aed5-4f37-a1a3-f964a7fa3e21 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:30.617770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65fbb-aed5-4f37-a1a3-f964a7fa3e21 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:30.618040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f65fbb-aed5-4f37-a1a3-f964a7fa3e21 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:30.619551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1301/2585] 10.222.0.13 () {54 vars in 921 bytes} [Wed Aug 31 11:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 11:28:30.625101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd4e26-0981-4570-9792-f17a093232b0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:30.625388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd4e26-0981-4570-9792-f17a093232b0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:30.625665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd4e26-0981-4570-9792-f17a093232b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:30.645593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1dfd4e26-0981-4570-9792-f17a093232b0 None None] MFA Rules not processed for user `c9c5d8bbcf07486ea3d3e26c81135d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:30.646781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1dfd4e26-0981-4570-9792-f17a093232b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:30.656734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1285/2586] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Aug 31 11:28:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:30.667118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65fbb-aed5-4f37-a1a3-f964a7fa3e21 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:30.677956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f65fbb-aed5-4f37-a1a3-f964a7fa3e21 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:30.681666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa3a4-2447-4d01-b184-c8e119bf80a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:30.682344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa3a4-2447-4d01-b184-c8e119bf80a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:30.682618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa3a4-2447-4d01-b184-c8e119bf80a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:30.682893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa3a4-2447-4d01-b184-c8e119bf80a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:30.693066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa3a4-2447-4d01-b184-c8e119bf80a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:30.694490 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa3a4-2447-4d01-b184-c8e119bf80a2 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:30.705704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1302/2587] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:33.605267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf278b-6eff-42f3-b378-6f647163b410 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:33.605694 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf278b-6eff-42f3-b378-6f647163b410 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:33.605813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf278b-6eff-42f3-b378-6f647163b410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:33.623474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa3a4-2447-4d01-b184-c8e119bf80a2 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:33.626634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ffcf278b-6eff-42f3-b378-6f647163b410 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:33.627712 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ffcf278b-6eff-42f3-b378-6f647163b410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:33.633730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa3a4-2447-4d01-b184-c8e119bf80a2 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:33.636191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1286/2588] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Aug 31 11:28:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:33.640966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dde0b-7ba2-4c62-af80-54eef274a99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:33.641571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dde0b-7ba2-4c62-af80-54eef274a99f service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:33.641847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dde0b-7ba2-4c62-af80-54eef274a99f service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:33.642144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dde0b-7ba2-4c62-af80-54eef274a99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:33.644467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a58dde0b-7ba2-4c62-af80-54eef274a99f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:33.649538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf278b-6eff-42f3-b378-6f647163b410 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:33.664364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf278b-6eff-42f3-b378-6f647163b410 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:33.669841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17cd4-3868-4795-a0d0-a53a0134a6df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:33.670846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17cd4-3868-4795-a0d0-a53a0134a6df service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:33.671306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17cd4-3868-4795-a0d0-a53a0134a6df service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:33.671585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17cd4-3868-4795-a0d0-a53a0134a6df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:33.682029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d17cd4-3868-4795-a0d0-a53a0134a6df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:33.683964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d17cd4-3868-4795-a0d0-a53a0134a6df service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:33.693517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1287/2589] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:28:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 11:28:33.728929 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dde0b-7ba2-4c62-af80-54eef274a99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:33.731162 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dde0b-7ba2-4c62-af80-54eef274a99f service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:33.742817 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1303/2590] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:28:37.998487 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17cd4-3868-4795-a0d0-a53a0134a6df service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:38.001437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-80d17cd4-3868-4795-a0d0-a53a0134a6df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:38.090103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17cd4-3868-4795-a0d0-a53a0134a6df service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:38.097118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:38.097859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:38.098211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:38.098558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] PATH_INFO: `/v3/users/ef569b9142a14d4e924af8692e75065a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:38.099857 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef569b9142a14d4e924af8692e75065a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:38.101848 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:38.288683 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef569b9142a14d4e924af8692e75065a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.298031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef569b9142a14d4e924af8692e75065a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.316717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef569b9142a14d4e924af8692e75065a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.317759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef569b9142a14d4e924af8692e75065a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.318686 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-263a40ed-210f-4fff-8128-93640fc95c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef569b9142a14d4e924af8692e75065a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.400462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1288/2591] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:28:37 2022] DELETE /identity/v3/users/ef569b9142a14d4e924af8692e75065a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:28:38.640195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dde0b-7ba2-4c62-af80-54eef274a99f service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:38.710255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dde0b-7ba2-4c62-af80-54eef274a99f service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:38.755628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:38.788021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:38.788251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:38.788615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:38.788887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] PATH_INFO: `/v3/projects/d259012fcc3249f1a7a1f596d72d8156` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:38.790136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d259012fcc3249f1a7a1f596d72d8156)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:38.792682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:38.893527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd259012fcc3249f1a7a1f596d72d8156', 'request_id': 'req-275d00e7-7945-4600-828d-212d6bff0b5d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.900028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd259012fcc3249f1a7a1f596d72d8156', 'request_id': 'req-275d00e7-7945-4600-828d-212d6bff0b5d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.905770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd259012fcc3249f1a7a1f596d72d8156', 'request_id': 'req-275d00e7-7945-4600-828d-212d6bff0b5d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.971392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] The token cache is being invalidate because project d259012fcc3249f1a7a1f596d72d8156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:28:38.971689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.972566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-275d00e7-7945-4600-828d-212d6bff0b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:28:38.974115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1304/2592] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:28:38 2022] DELETE /identity/v3/projects/d259012fcc3249f1a7a1f596d72d8156 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:28:38.979899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d590a0e-e5b2-4cd4-94e1-cefffb33de86 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:38.986396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d590a0e-e5b2-4cd4-94e1-cefffb33de86 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:38.986396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d590a0e-e5b2-4cd4-94e1-cefffb33de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.018703 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:39.045130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2d590a0e-e5b2-4cd4-94e1-cefffb33de86 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:39.046361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2d590a0e-e5b2-4cd4-94e1-cefffb33de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:39.112680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1289/2593] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:39.121404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324d151-e758-4ae2-97dd-bc1bc55c155b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.121690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324d151-e758-4ae2-97dd-bc1bc55c155b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.121973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324d151-e758-4ae2-97dd-bc1bc55c155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.142917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8324d151-e758-4ae2-97dd-bc1bc55c155b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:39.144247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8324d151-e758-4ae2-97dd-bc1bc55c155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:39.152956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1305/2594] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:28:39.157538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d590a0e-e5b2-4cd4-94e1-cefffb33de86 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:39.168052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d590a0e-e5b2-4cd4-94e1-cefffb33de86 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:39.172595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f292001-be98-48b7-88a9-9814e846fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:39.173191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f292001-be98-48b7-88a9-9814e846fcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.173473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f292001-be98-48b7-88a9-9814e846fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.173744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f292001-be98-48b7-88a9-9814e846fcf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.174381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f292001-be98-48b7-88a9-9814e846fcf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:28:39.174681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f292001-be98-48b7-88a9-9814e846fcf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:39.176310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f292001-be98-48b7-88a9-9814e846fcf6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:39.189517 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1290/2595] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:28:39.193733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324d151-e758-4ae2-97dd-bc1bc55c155b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:39.203823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324d151-e758-4ae2-97dd-bc1bc55c155b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:39.208676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b79e8-b396-46e2-ac78-e787c343ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:39.209284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b79e8-b396-46e2-ac78-e787c343ac26 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.209560 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b79e8-b396-46e2-ac78-e787c343ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.209830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b79e8-b396-46e2-ac78-e787c343ac26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.210471 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b79e8-b396-46e2-ac78-e787c343ac26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:39.213004 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b79e8-b396-46e2-ac78-e787c343ac26 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:39.298982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1306/2596] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:28:39 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:28:39.303206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f292001-be98-48b7-88a9-9814e846fcf6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:39.314113 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f292001-be98-48b7-88a9-9814e846fcf6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:39.374900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca8a2-3c39-4e73-9f0a-8fa11d313c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:39.375597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca8a2-3c39-4e73-9f0a-8fa11d313c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.375998 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca8a2-3c39-4e73-9f0a-8fa11d313c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.376344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca8a2-3c39-4e73-9f0a-8fa11d313c36 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.377052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ca8a2-3c39-4e73-9f0a-8fa11d313c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:39.379478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ca8a2-3c39-4e73-9f0a-8fa11d313c36 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:39.503338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1291/2597] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:28:39 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:28:39.507465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b79e8-b396-46e2-ac78-e787c343ac26 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:39.518908 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b79e8-b396-46e2-ac78-e787c343ac26 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:39.523671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5acb8-8d7f-4877-a7f6-efcfb86f43ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:39.524326 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5acb8-8d7f-4877-a7f6-efcfb86f43ea admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.525286 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5acb8-8d7f-4877-a7f6-efcfb86f43ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.525568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5acb8-8d7f-4877-a7f6-efcfb86f43ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.526392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5acb8-8d7f-4877-a7f6-efcfb86f43ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:39.528055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5acb8-8d7f-4877-a7f6-efcfb86f43ea admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:39.546173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1307/2598] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:28:39.547367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca8a2-3c39-4e73-9f0a-8fa11d313c36 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:39.559033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ca8a2-3c39-4e73-9f0a-8fa11d313c36 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:39.564061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308044aa-cac0-4875-97d6-54947bf304b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:39.565466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308044aa-cac0-4875-97d6-54947bf304b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.565466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308044aa-cac0-4875-97d6-54947bf304b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.565466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308044aa-cac0-4875-97d6-54947bf304b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.565892 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308044aa-cac0-4875-97d6-54947bf304b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:39.567477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308044aa-cac0-4875-97d6-54947bf304b6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:39.579709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1292/2599] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:28:39.583622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5acb8-8d7f-4877-a7f6-efcfb86f43ea admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:39.595390 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5acb8-8d7f-4877-a7f6-efcfb86f43ea admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:39.600705 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff433b-25d9-4913-baee-7cb41b1383f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:39.601663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff433b-25d9-4913-baee-7cb41b1383f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.602126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff433b-25d9-4913-baee-7cb41b1383f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.602467 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff433b-25d9-4913-baee-7cb41b1383f7 admin admin] PATH_INFO: `/v3/projects/e37a473075e242d8b87b342636e12bb2/users/5d25410e164f4a08b4013eeee09e10e2/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.618165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff433b-25d9-4913-baee-7cb41b1383f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37a473075e242d8b87b342636e12bb2, user_id=5d25410e164f4a08b4013eeee09e10e2, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:39.621075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff433b-25d9-4913-baee-7cb41b1383f7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:39.703218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1308/2600] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:28:39 2022] PUT /identity/v3/projects/e37a473075e242d8b87b342636e12bb2/users/5d25410e164f4a08b4013eeee09e10e2/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:28:39.709239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa37e2-8e86-4458-bc0b-da018a0cf9f2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.709522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa37e2-8e86-4458-bc0b-da018a0cf9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.709794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa37e2-8e86-4458-bc0b-da018a0cf9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.730589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-50fa37e2-8e86-4458-bc0b-da018a0cf9f2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:39.731968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-50fa37e2-8e86-4458-bc0b-da018a0cf9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:39.793913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:39.802326 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1293/2601] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:39.813971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff433b-25d9-4913-baee-7cb41b1383f7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:39.815672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-32ff433b-25d9-4913-baee-7cb41b1383f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:39.892717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:28:39.897731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff433b-25d9-4913-baee-7cb41b1383f7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:39.903219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148485e-7f88-4673-a6e7-eeeff8284ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:39.904072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148485e-7f88-4673-a6e7-eeeff8284ecf service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:39.904511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148485e-7f88-4673-a6e7-eeeff8284ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:39.904935 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148485e-7f88-4673-a6e7-eeeff8284ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:39.915795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148485e-7f88-4673-a6e7-eeeff8284ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:39.917519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148485e-7f88-4673-a6e7-eeeff8284ecf service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:39.929345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1309/2602] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:46.846571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae98c3-0d54-4a39-b346-74e93f19d65a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:46.847150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae98c3-0d54-4a39-b346-74e93f19d65a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:46.847150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae98c3-0d54-4a39-b346-74e93f19d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:46.875521 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4fae98c3-0d54-4a39-b346-74e93f19d65a None None] MFA Rules not processed for user `5d25410e164f4a08b4013eeee09e10e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:46.876767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4fae98c3-0d54-4a39-b346-74e93f19d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:46.952217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1294/2603] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:28:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:46.966571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148485e-7f88-4673-a6e7-eeeff8284ecf service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:46.968202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2148485e-7f88-4673-a6e7-eeeff8284ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:47.088611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148485e-7f88-4673-a6e7-eeeff8284ecf service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:47.094132 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f2a8-592b-47f4-8d34-d0d990094855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:47.094799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f2a8-592b-47f4-8d34-d0d990094855 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:47.095075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f2a8-592b-47f4-8d34-d0d990094855 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:47.095366 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f2a8-592b-47f4-8d34-d0d990094855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:47.104177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f2a8-592b-47f4-8d34-d0d990094855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:47.105757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f2a8-592b-47f4-8d34-d0d990094855 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:47.114518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1310/2604] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:28:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:28:49.597784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b175f-1b14-41e5-bfec-8efd4995d6ac None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:49.597784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b175f-1b14-41e5-bfec-8efd4995d6ac None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:49.597784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b175f-1b14-41e5-bfec-8efd4995d6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:49.624197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-491b175f-1b14-41e5-bfec-8efd4995d6ac None None] MFA Rules not processed for user `5d25410e164f4a08b4013eeee09e10e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:49.626034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-491b175f-1b14-41e5-bfec-8efd4995d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:49.633973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1295/2605] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:28:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:54.382855 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88eab2-1b73-45b0-b8fd-c2d0e8ebe727 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:54.383531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88eab2-1b73-45b0-b8fd-c2d0e8ebe727 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:54.383531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88eab2-1b73-45b0-b8fd-c2d0e8ebe727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:54.415737 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6f88eab2-1b73-45b0-b8fd-c2d0e8ebe727 None None] MFA Rules not processed for user `623fd6adf2af4122a5a507efb4e0cbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:28:54.417180 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6f88eab2-1b73-45b0-b8fd-c2d0e8ebe727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:54.479419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1311/2606] 10.222.0.13 () {58 vars in 967 bytes} [Wed Aug 31 11:28:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:28:54.493219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b175f-1b14-41e5-bfec-8efd4995d6ac None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:28:54.494695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-491b175f-1b14-41e5-bfec-8efd4995d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:28:54.569127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b175f-1b14-41e5-bfec-8efd4995d6ac None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:28:54.575430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708054ca-9e01-4081-a195-6418f1babb01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c91e3eec414a5189befb91012955c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:28:54.576079 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708054ca-9e01-4081-a195-6418f1babb01 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:28:54.576881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708054ca-9e01-4081-a195-6418f1babb01 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:28:54.576881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708054ca-9e01-4081-a195-6418f1babb01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:28:54.585438 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708054ca-9e01-4081-a195-6418f1babb01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:28:54.587666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708054ca-9e01-4081-a195-6418f1babb01 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:28:54.596353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1296/2607] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Aug 31 11:28:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 11:29:04.471569 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=79 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:04.592733 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=67 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:29:42.940014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88eab2-1b73-45b0-b8fd-c2d0e8ebe727 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:29:42.941424 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6f88eab2-1b73-45b0-b8fd-c2d0e8ebe727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:43.031990 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88eab2-1b73-45b0-b8fd-c2d0e8ebe727 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:29:43.037160 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:29:43.037765 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:29:43.038042 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:29:43.038315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:29:43.040118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:29:43.051621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:29:43.053289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:29:43.063938 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1312/2608] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:29:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:29:53.058898 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=41 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:00.302030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708054ca-9e01-4081-a195-6418f1babb01 service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:00.321960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708054ca-9e01-4081-a195-6418f1babb01 service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:00.325678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea3471-7a12-48d3-9fee-fdb20acb3ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:00.326271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea3471-7a12-48d3-9fee-fdb20acb3ffb service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:00.326548 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea3471-7a12-48d3-9fee-fdb20acb3ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:00.326820 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea3471-7a12-48d3-9fee-fdb20acb3ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:00.329124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c4ea3471-7a12-48d3-9fee-fdb20acb3ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:00.340663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea3471-7a12-48d3-9fee-fdb20acb3ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:00.342070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea3471-7a12-48d3-9fee-fdb20acb3ffb service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:00.351761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1297/2609] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:30:04.109115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:04.110688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:04.124985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5205842-3192-42ed-9591-a37d7f1734b1 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:04.129686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:04.134430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:04.134430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:04.134430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] PATH_INFO: `/v3/users/713abcb6fbc1425a83aa794243ea93d5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:04.134430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713abcb6fbc1425a83aa794243ea93d5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:04.134430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:04.274831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713abcb6fbc1425a83aa794243ea93d5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.280956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713abcb6fbc1425a83aa794243ea93d5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.375785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713abcb6fbc1425a83aa794243ea93d5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.376375 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713abcb6fbc1425a83aa794243ea93d5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.389670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a45d48b5-9cb2-463b-8bdc-e2dcd0f880b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713abcb6fbc1425a83aa794243ea93d5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.402514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1313/2610] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:30:04 2022] DELETE /identity/v3/users/713abcb6fbc1425a83aa794243ea93d5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:30:04.636335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea3471-7a12-48d3-9fee-fdb20acb3ffb service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:04.650341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea3471-7a12-48d3-9fee-fdb20acb3ffb service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:04.711702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:04.712390 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:04.712666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:04.712932 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] PATH_INFO: `/v3/projects/6322bdbef417485c81287e9238a1c751` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:04.714075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6322bdbef417485c81287e9238a1c751)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:04.716048 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:04.829232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6322bdbef417485c81287e9238a1c751', 'request_id': 'req-831de957-3e2f-4361-a605-6c225da5f9d3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.835688 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6322bdbef417485c81287e9238a1c751', 'request_id': 'req-831de957-3e2f-4361-a605-6c225da5f9d3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.910095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6322bdbef417485c81287e9238a1c751', 'request_id': 'req-831de957-3e2f-4361-a605-6c225da5f9d3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.921456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] The token cache is being invalidate because project 6322bdbef417485c81287e9238a1c751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:30:04.921817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.922461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-831de957-3e2f-4361-a605-6c225da5f9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:30:04.923997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1298/2611] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:30:04 2022] DELETE /identity/v3/projects/6322bdbef417485c81287e9238a1c751 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:30:04.928953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc7c7-57d5-440c-801c-63854f07f77f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:04.929237 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc7c7-57d5-440c-801c-63854f07f77f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:04.929538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc7c7-57d5-440c-801c-63854f07f77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:04.949962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-594cc7c7-57d5-440c-801c-63854f07f77f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:04.951159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-594cc7c7-57d5-440c-801c-63854f07f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:05.010005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1314/2612] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:30:05.018774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8e31b-7ab9-4ade-8202-3869d9a76a3e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:05.019059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8e31b-7ab9-4ade-8202-3869d9a76a3e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:05.019334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8e31b-7ab9-4ade-8202-3869d9a76a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:05.039136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1ee8e31b-7ab9-4ade-8202-3869d9a76a3e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:05.040362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1ee8e31b-7ab9-4ade-8202-3869d9a76a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:05.048464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1299/2613] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:30:05.052853 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc7c7-57d5-440c-801c-63854f07f77f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:05.063204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc7c7-57d5-440c-801c-63854f07f77f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:05.067735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad600d-4939-467f-984c-357793deeca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:05.068348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad600d-4939-467f-984c-357793deeca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:05.068622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad600d-4939-467f-984c-357793deeca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:05.068893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad600d-4939-467f-984c-357793deeca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:05.069527 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad600d-4939-467f-984c-357793deeca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:30:05.069823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad600d-4939-467f-984c-357793deeca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:05.071400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad600d-4939-467f-984c-357793deeca9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:05.083878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1315/2614] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:30:05.088147 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8e31b-7ab9-4ade-8202-3869d9a76a3e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:05.097989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8e31b-7ab9-4ade-8202-3869d9a76a3e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:05.102718 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb538af-c14e-46df-90f3-06f8eeb7ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:05.103309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb538af-c14e-46df-90f3-06f8eeb7ac5e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:05.103588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb538af-c14e-46df-90f3-06f8eeb7ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:05.103899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb538af-c14e-46df-90f3-06f8eeb7ac5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:05.104534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb538af-c14e-46df-90f3-06f8eeb7ac5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:05.106424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb538af-c14e-46df-90f3-06f8eeb7ac5e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:05.191558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1300/2615] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:30:05 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:30:05.196063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad600d-4939-467f-984c-357793deeca9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:05.206912 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad600d-4939-467f-984c-357793deeca9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:05.263078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7733e-7030-42d4-a1fe-883d61fb2e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:05.263678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7733e-7030-42d4-a1fe-883d61fb2e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:05.263985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7733e-7030-42d4-a1fe-883d61fb2e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:05.264257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7733e-7030-42d4-a1fe-883d61fb2e21 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:05.265406 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7733e-7030-42d4-a1fe-883d61fb2e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:05.267549 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7733e-7030-42d4-a1fe-883d61fb2e21 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:05.275428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:05.355005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1316/2616] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:30:05 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:30:05.359304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb538af-c14e-46df-90f3-06f8eeb7ac5e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:05.369744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb538af-c14e-46df-90f3-06f8eeb7ac5e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:05.374785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61ad00-b3c9-43d4-9161-3a46a63c754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:05.375559 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61ad00-b3c9-43d4-9161-3a46a63c754e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:05.375859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61ad00-b3c9-43d4-9161-3a46a63c754e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:05.376132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61ad00-b3c9-43d4-9161-3a46a63c754e admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:05.376774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61ad00-b3c9-43d4-9161-3a46a63c754e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:05.378357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61ad00-b3c9-43d4-9161-3a46a63c754e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:05.388907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1301/2617] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:30:05.393204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7733e-7030-42d4-a1fe-883d61fb2e21 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:05.403208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7733e-7030-42d4-a1fe-883d61fb2e21 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:05.408752 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7de55-d567-4b22-9baf-145a5d9b0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:05.409513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7de55-d567-4b22-9baf-145a5d9b0581 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:05.409795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7de55-d567-4b22-9baf-145a5d9b0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:05.410064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7de55-d567-4b22-9baf-145a5d9b0581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:05.410706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7de55-d567-4b22-9baf-145a5d9b0581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:05.412331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7de55-d567-4b22-9baf-145a5d9b0581 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:05.423303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1317/2618] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:30:05.427456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61ad00-b3c9-43d4-9161-3a46a63c754e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:05.437989 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61ad00-b3c9-43d4-9161-3a46a63c754e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:05.442690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec1304-86ab-4631-9924-635da570b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:05.443332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec1304-86ab-4631-9924-635da570b9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:05.443609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec1304-86ab-4631-9924-635da570b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:05.443925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec1304-86ab-4631-9924-635da570b9e9 admin admin] PATH_INFO: `/v3/projects/c62636149d5344afb63325a435f25c34/users/ee53d2aaeaaf4ad796814293638123ba/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:05.459635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec1304-86ab-4631-9924-635da570b9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62636149d5344afb63325a435f25c34, user_id=ee53d2aaeaaf4ad796814293638123ba, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:05.462352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec1304-86ab-4631-9924-635da570b9e9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:05.561594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1302/2619] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:30:05 2022] PUT /identity/v3/projects/c62636149d5344afb63325a435f25c34/users/ee53d2aaeaaf4ad796814293638123ba/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:30:05.567876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec554d-8c03-4241-8c92-2d83cc6159f3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:05.568167 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec554d-8c03-4241-8c92-2d83cc6159f3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:05.568445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec554d-8c03-4241-8c92-2d83cc6159f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:05.589400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a4ec554d-8c03-4241-8c92-2d83cc6159f3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:05.590617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a4ec554d-8c03-4241-8c92-2d83cc6159f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:05.656300 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1318/2620] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:30:05.667868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec1304-86ab-4631-9924-635da570b9e9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:05.669661 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5aec1304-86ab-4631-9924-635da570b9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:05.675866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:05.742845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec1304-86ab-4631-9924-635da570b9e9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:05.746433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48fe6-8bf5-4cac-a3e0-f67d6ef81b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:05.747033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48fe6-8bf5-4cac-a3e0-f67d6ef81b32 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:05.747306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48fe6-8bf5-4cac-a3e0-f67d6ef81b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:05.747573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48fe6-8bf5-4cac-a3e0-f67d6ef81b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:05.757211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48fe6-8bf5-4cac-a3e0-f67d6ef81b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:05.758624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b48fe6-8bf5-4cac-a3e0-f67d6ef81b32 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:05.768404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1303/2621] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:30:11.311706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93549-813d-4966-93fe-c7643e0ed96e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:11.313014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93549-813d-4966-93fe-c7643e0ed96e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:11.313140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93549-813d-4966-93fe-c7643e0ed96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:11.345292 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-76f93549-813d-4966-93fe-c7643e0ed96e None None] MFA Rules not processed for user `ee53d2aaeaaf4ad796814293638123ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:11.346689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-76f93549-813d-4966-93fe-c7643e0ed96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:11.438567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1319/2622] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:30:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:30:11.454294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48fe6-8bf5-4cac-a3e0-f67d6ef81b32 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:11.455873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-81b48fe6-8bf5-4cac-a3e0-f67d6ef81b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:11.539310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48fe6-8bf5-4cac-a3e0-f67d6ef81b32 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:11.546722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fe7d3-bb74-4f23-8c63-1e8dc44b99a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:11.547930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fe7d3-bb74-4f23-8c63-1e8dc44b99a7 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:11.548499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fe7d3-bb74-4f23-8c63-1e8dc44b99a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:11.548980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fe7d3-bb74-4f23-8c63-1e8dc44b99a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:11.559080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fe7d3-bb74-4f23-8c63-1e8dc44b99a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:11.560729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fe7d3-bb74-4f23-8c63-1e8dc44b99a7 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:11.574131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1304/2623] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:30:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:30:14.305949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a5b2-f343-460e-bd7d-404e56c40cb2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:14.305949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a5b2-f343-460e-bd7d-404e56c40cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:14.305949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a5b2-f343-460e-bd7d-404e56c40cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:14.350134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3810a5b2-f343-460e-bd7d-404e56c40cb2 None None] MFA Rules not processed for user `ee53d2aaeaaf4ad796814293638123ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:30:14.352082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3810a5b2-f343-460e-bd7d-404e56c40cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:14.366685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1320/2624] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:30:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:30:14.817452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fe7d3-bb74-4f23-8c63-1e8dc44b99a7 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:14.819473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8c8fe7d3-bb74-4f23-8c63-1e8dc44b99a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:14.838626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fe7d3-bb74-4f23-8c63-1e8dc44b99a7 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:14.843788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08f4d4-6bcd-459f-a972-9cddf04953a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:14.844699 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f4d4-6bcd-459f-a972-9cddf04953a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:14.845140 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f4d4-6bcd-459f-a972-9cddf04953a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:14.845571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08f4d4-6bcd-459f-a972-9cddf04953a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:14.847680 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5e08f4d4-6bcd-459f-a972-9cddf04953a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:14.859427 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08f4d4-6bcd-459f-a972-9cddf04953a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:14.861328 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08f4d4-6bcd-459f-a972-9cddf04953a2 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:14.871606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1305/2625] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:30:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:30:16.631946 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a5b2-f343-460e-bd7d-404e56c40cb2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:16.642942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a5b2-f343-460e-bd7d-404e56c40cb2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:16.646738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:16.648140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:16.648625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:16.649091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:16.652066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:16.664607 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:16.666541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:16.693971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1321/2626] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:30:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:30:16.768108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08f4d4-6bcd-459f-a972-9cddf04953a2 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:30:16.777684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08f4d4-6bcd-459f-a972-9cddf04953a2 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:30:16.782635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c455f-7f37-43b1-9e8c-0350095dbd25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:30:16.783284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c455f-7f37-43b1-9e8c-0350095dbd25 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:30:16.786100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c455f-7f37-43b1-9e8c-0350095dbd25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:30:16.786100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c455f-7f37-43b1-9e8c-0350095dbd25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:30:16.786100 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ad3c455f-7f37-43b1-9e8c-0350095dbd25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:30:16.800039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c455f-7f37-43b1-9e8c-0350095dbd25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:30:16.801489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c455f-7f37-43b1-9e8c-0350095dbd25 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:30:16.813785 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1306/2627] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:30:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:30:26.673173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=3,keystone:SELECT=75 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:30:26.807593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=75 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:31:44.101601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:31:44.103271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:31:44.188580 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40f22b-d1f5-4777-aacd-d5772b9d3a8d service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:31:44.192423 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26516459-0ce4-47a2-be02-76eef25ad614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:31:44.193030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26516459-0ce4-47a2-be02-76eef25ad614 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:31:44.193485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26516459-0ce4-47a2-be02-76eef25ad614 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:31:44.193766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26516459-0ce4-47a2-be02-76eef25ad614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:31:44.195587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-26516459-0ce4-47a2-be02-76eef25ad614 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:31:44.216803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26516459-0ce4-47a2-be02-76eef25ad614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:31:44.216803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26516459-0ce4-47a2-be02-76eef25ad614 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:31:44.226635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1322/2628] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:31:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:31:47.071609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c455f-7f37-43b1-9e8c-0350095dbd25 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:31:47.080666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c455f-7f37-43b1-9e8c-0350095dbd25 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:31:47.084547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84158c8-03d2-4441-90d2-4f9a2fd02e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:31:47.085144 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84158c8-03d2-4441-90d2-4f9a2fd02e70 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:31:47.085481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84158c8-03d2-4441-90d2-4f9a2fd02e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:31:47.085759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84158c8-03d2-4441-90d2-4f9a2fd02e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:31:47.087684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f84158c8-03d2-4441-90d2-4f9a2fd02e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:31:47.103191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84158c8-03d2-4441-90d2-4f9a2fd02e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:31:47.105393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84158c8-03d2-4441-90d2-4f9a2fd02e70 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:31:47.117729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1307/2629] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:31:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:31:48.657847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26516459-0ce4-47a2-be02-76eef25ad614 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:31:48.667891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26516459-0ce4-47a2-be02-76eef25ad614 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:31:48.671460 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a98876-a04e-4ebd-b2cc-c02d6f8ff300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:31:48.672087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98876-a04e-4ebd-b2cc-c02d6f8ff300 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:31:48.672365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98876-a04e-4ebd-b2cc-c02d6f8ff300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:31:48.672631 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98876-a04e-4ebd-b2cc-c02d6f8ff300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:31:48.674342 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-21a98876-a04e-4ebd-b2cc-c02d6f8ff300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:31:48.683793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a98876-a04e-4ebd-b2cc-c02d6f8ff300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:31:48.685202 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a98876-a04e-4ebd-b2cc-c02d6f8ff300 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:31:48.693373 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1323/2630] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:31:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:31:57.000980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825c4a7-88d8-4397-8ffc-3f5e1c4f7481 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:31:57.005635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825c4a7-88d8-4397-8ffc-3f5e1c4f7481 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:31:57.005635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825c4a7-88d8-4397-8ffc-3f5e1c4f7481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:31:57.021516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5825c4a7-88d8-4397-8ffc-3f5e1c4f7481 None None] MFA Rules not processed for user `ee53d2aaeaaf4ad796814293638123ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:31:57.022755 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5825c4a7-88d8-4397-8ffc-3f5e1c4f7481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:31:57.030831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1308/2631] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:31:57.352765 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a98876-a04e-4ebd-b2cc-c02d6f8ff300 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:31:57.361493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a98876-a04e-4ebd-b2cc-c02d6f8ff300 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:31:57.366693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:31:57.366693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:31:57.366693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:31:57.366693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:31:57.368303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:31:57.379134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:31:57.380606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:31:57.389330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1324/2632] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:31:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:31:57.965923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825c4a7-88d8-4397-8ffc-3f5e1c4f7481 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:31:57.967398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5825c4a7-88d8-4397-8ffc-3f5e1c4f7481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:31:58.041018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825c4a7-88d8-4397-8ffc-3f5e1c4f7481 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:31:58.046642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777a108-5d95-4f19-8ed8-8dcb119d6acb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:31:58.047248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777a108-5d95-4f19-8ed8-8dcb119d6acb service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:31:58.047528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777a108-5d95-4f19-8ed8-8dcb119d6acb service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:31:58.047840 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777a108-5d95-4f19-8ed8-8dcb119d6acb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:31:58.049598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1777a108-5d95-4f19-8ed8-8dcb119d6acb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:31:58.061578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777a108-5d95-4f19-8ed8-8dcb119d6acb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:31:58.063415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777a108-5d95-4f19-8ed8-8dcb119d6acb service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:31:58.073150 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1309/2633] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:31:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:03.079910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:03.079910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:03.093319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5aefcf-44d9-4caf-b5d8-38663c27c061 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:03.099020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28966306-3c65-42e2-b946-afad23be5148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:03.100030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28966306-3c65-42e2-b946-afad23be5148 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:03.100307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28966306-3c65-42e2-b946-afad23be5148 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:03.100748 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28966306-3c65-42e2-b946-afad23be5148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:03.102543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-28966306-3c65-42e2-b946-afad23be5148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:03.119828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28966306-3c65-42e2-b946-afad23be5148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:03.119828 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28966306-3c65-42e2-b946-afad23be5148 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:03.132509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1325/2634] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:08.068995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=41 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:13.124348 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=53 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:15.319352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777a108-5d95-4f19-8ed8-8dcb119d6acb service placement] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:15.332049 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777a108-5d95-4f19-8ed8-8dcb119d6acb service placement] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:15.337457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101f0cc-584c-4976-8f4a-28dc757c7ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:15.338050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f0cc-584c-4976-8f4a-28dc757c7ef3 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:15.338323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f0cc-584c-4976-8f4a-28dc757c7ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:15.338591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f0cc-584c-4976-8f4a-28dc757c7ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:15.340312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d101f0cc-584c-4976-8f4a-28dc757c7ef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:15.353151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101f0cc-584c-4976-8f4a-28dc757c7ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:15.354719 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101f0cc-584c-4976-8f4a-28dc757c7ef3 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:15.365259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1310/2635] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:32:15.597444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28966306-3c65-42e2-b946-afad23be5148 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:15.607926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28966306-3c65-42e2-b946-afad23be5148 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:15.611658 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:15.612385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:15.612733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:15.613076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:15.614886 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:15.679063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:15.680541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:15.691329 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1326/2636] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:22.426572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101f0cc-584c-4976-8f4a-28dc757c7ef3 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:22.436214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101f0cc-584c-4976-8f4a-28dc757c7ef3 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:22.440956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793afa19-67f5-4005-97d0-c49ede42f27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:22.441556 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793afa19-67f5-4005-97d0-c49ede42f27c service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:22.441837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793afa19-67f5-4005-97d0-c49ede42f27c service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:22.442117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793afa19-67f5-4005-97d0-c49ede42f27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:22.443905 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-793afa19-67f5-4005-97d0-c49ede42f27c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:22.456774 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793afa19-67f5-4005-97d0-c49ede42f27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:22.458644 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793afa19-67f5-4005-97d0-c49ede42f27c service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:22.472599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1311/2637] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:25.686165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=28 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:25.788941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:25.790482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:25.806195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed74aa-bd34-42f3-8549-cc21c4d444cf service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:25.811608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:25.815586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:25.815586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:25.815586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:25.815586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:25.828355 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:25.830617 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:25.841246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1327/2638] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:29.491822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793afa19-67f5-4005-97d0-c49ede42f27c service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:29.504379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793afa19-67f5-4005-97d0-c49ede42f27c service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:29.509526 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5132ab-16cf-4186-bc09-c3a7561672db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:29.510125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5132ab-16cf-4186-bc09-c3a7561672db service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:29.510409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5132ab-16cf-4186-bc09-c3a7561672db service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:29.510687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5132ab-16cf-4186-bc09-c3a7561672db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:29.512437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8c5132ab-16cf-4186-bc09-c3a7561672db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:29.524999 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5132ab-16cf-4186-bc09-c3a7561672db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:29.526588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5132ab-16cf-4186-bc09-c3a7561672db service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:29.537768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1312/2639] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:32:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:32:29.622982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:29.624641 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:29.638447 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f578-2e44-43e5-99bd-ca1845e41706 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:29.643345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:29.644008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:29.644291 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:29.644597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] PATH_INFO: `/v3/users/32373b6ee59d46e0bf693c1e34995172` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:29.645747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32373b6ee59d46e0bf693c1e34995172)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:29.647647 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:29.829735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32373b6ee59d46e0bf693c1e34995172'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:29.830385 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32373b6ee59d46e0bf693c1e34995172'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:29.901805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32373b6ee59d46e0bf693c1e34995172'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:29.902479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32373b6ee59d46e0bf693c1e34995172'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:29.915571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32373b6ee59d46e0bf693c1e34995172'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:29.928442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1328/2640] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:32:29 2022] DELETE /identity/v3/users/32373b6ee59d46e0bf693c1e34995172 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:32:30.178826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5132ab-16cf-4186-bc09-c3a7561672db service placement] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:30.190487 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5132ab-16cf-4186-bc09-c3a7561672db service placement] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:30.248164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:30.248796 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:30.249105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:30.249395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] PATH_INFO: `/v3/projects/2ab5fbab225448ed8aca54a931186f2c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:30.250555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab5fbab225448ed8aca54a931186f2c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:30.252489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:30.367502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab5fbab225448ed8aca54a931186f2c', 'request_id': 'req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.375861 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab5fbab225448ed8aca54a931186f2c', 'request_id': 'req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.480542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab5fbab225448ed8aca54a931186f2c', 'request_id': 'req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.491818 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] The token cache is being invalidate because project 2ab5fbab225448ed8aca54a931186f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:32:30.492105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.492768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.494255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1313/2641] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:32:30 2022] DELETE /identity/v3/projects/2ab5fbab225448ed8aca54a931186f2c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:32:30.498364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:30.500384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:30.513843 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49fd10-1ec3-4f83-b89e-37d2b819a6f7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:30.571486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:30.572154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:30.572435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:30.572708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] PATH_INFO: `/v3/users/b3f991f98e0a4fd7a7de22752d6df0ee` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:30.573941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f991f98e0a4fd7a7de22752d6df0ee)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:30.576058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:30.778744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f991f98e0a4fd7a7de22752d6df0ee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.779393 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f991f98e0a4fd7a7de22752d6df0ee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.850256 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f991f98e0a4fd7a7de22752d6df0ee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.850871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f991f98e0a4fd7a7de22752d6df0ee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.856488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:30.863535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f85aed37-be0f-43e9-be68-2644cf0439b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f991f98e0a4fd7a7de22752d6df0ee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:30.875473 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1329/2642] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:32:30 2022] DELETE /identity/v3/users/b3f991f98e0a4fd7a7de22752d6df0ee => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:32:31.122203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:32:31.123773 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:32:31.137259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28720386-fcc8-41f2-a94d-1bbbc87c6b4b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:32:31.185995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:31.196387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:32:31.197014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:32:31.198173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:32:31.198173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] PATH_INFO: `/v3/projects/debb1e62c7524c45bdbe8fe7e4d58c1a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:32:31.198681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] RBAC: Authorizing `identity:delete_project(project_id=debb1e62c7524c45bdbe8fe7e4d58c1a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:32:31.200648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:32:31.325780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'debb1e62c7524c45bdbe8fe7e4d58c1a', 'request_id': 'req-1907eb92-7ab1-4b8a-97de-97b3f880445a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:31.332060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'debb1e62c7524c45bdbe8fe7e4d58c1a', 'request_id': 'req-1907eb92-7ab1-4b8a-97de-97b3f880445a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:31.422181 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'debb1e62c7524c45bdbe8fe7e4d58c1a', 'request_id': 'req-1907eb92-7ab1-4b8a-97de-97b3f880445a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:31.433124 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] The token cache is being invalidate because project debb1e62c7524c45bdbe8fe7e4d58c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:32:31.433441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:31.434082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:32:31.435557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1314/2643] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:32:31 2022] DELETE /identity/v3/projects/debb1e62c7524c45bdbe8fe7e4d58c1a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:32:41.050165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=9,keystone:DELETE=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:32:41.430031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:33:12.875305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98bea-072f-4b3e-9a0c-ef7832f59252 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:33:12.875919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98bea-072f-4b3e-9a0c-ef7832f59252 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:33:12.875919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd98bea-072f-4b3e-9a0c-ef7832f59252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:33:12.896882 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7cd98bea-072f-4b3e-9a0c-ef7832f59252 None None] MFA Rules not processed for user `5d25410e164f4a08b4013eeee09e10e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:33:12.899229 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7cd98bea-072f-4b3e-9a0c-ef7832f59252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:33:12.954568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1330/2644] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:33:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:33:22.947620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=25 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:33:25.287694 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:33:25.289348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:33:25.362191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907eb92-7ab1-4b8a-97de-97b3f880445a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:33:25.368983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:33:25.369595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:33:25.370000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:33:25.370277 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:33:25.372072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:33:25.385338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:33:25.386944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:33:25.398724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1315/2645] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:33:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:33:35.393119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=34 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:33:47.005679 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13f66e-8183-4536-bf5c-91f051d95024 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:33:47.006190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13f66e-8183-4536-bf5c-91f051d95024 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:33:47.006296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13f66e-8183-4536-bf5c-91f051d95024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:33:47.027966 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cb13f66e-8183-4536-bf5c-91f051d95024 None None] MFA Rules not processed for user `ee53d2aaeaaf4ad796814293638123ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:33:47.030589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cb13f66e-8183-4536-bf5c-91f051d95024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:33:47.084449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1331/2646] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:33:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:33:57.077717 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=25 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:45.062567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:45.069617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:45.077805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54c215-6f3c-415d-a002-aa5ce2461043 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:45.083313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:45.083930 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:45.084207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:45.084474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:45.086131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:45.096120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:45.100827 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:45.107060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1316/2647] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:45.980005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13f66e-8183-4536-bf5c-91f051d95024 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:34:45.981543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cb13f66e-8183-4536-bf5c-91f051d95024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:46.050198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13f66e-8183-4536-bf5c-91f051d95024 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:34:46.055283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:34:46.055925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:34:46.056201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:34:46.056468 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:34:46.058176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:34:46.070685 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:34:46.072320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:34:46.082708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1332/2648] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:34:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:34:55.103059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:34:56.077852 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=32 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:10.307337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:10.309398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:10.365339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5775c-740c-495d-a460-0016013e5270 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:10.368973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240488-61d7-4773-b9af-f3ca29eac9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:10.369570 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240488-61d7-4773-b9af-f3ca29eac9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:10.369845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240488-61d7-4773-b9af-f3ca29eac9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:10.370115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240488-61d7-4773-b9af-f3ca29eac9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:10.372929 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-22240488-61d7-4773-b9af-f3ca29eac9e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:10.435458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22240488-61d7-4773-b9af-f3ca29eac9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:10.436922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22240488-61d7-4773-b9af-f3ca29eac9e0 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:10.446736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1317/2649] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:14.090029 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.092129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:14.105693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4d448-8eee-4fa8-907b-c2359a3941d6 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.110930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.114336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.114336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.114336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] PATH_INFO: `/v3/users/5d25410e164f4a08b4013eeee09e10e2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.114336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d25410e164f4a08b4013eeee09e10e2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.115135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.313896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d25410e164f4a08b4013eeee09e10e2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.314915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d25410e164f4a08b4013eeee09e10e2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.380244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d25410e164f4a08b4013eeee09e10e2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.380867 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d25410e164f4a08b4013eeee09e10e2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.393785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8e518dd7-74c6-4e39-93a1-e7efef01b60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d25410e164f4a08b4013eeee09e10e2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.407290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1333/2650] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:14 2022] DELETE /identity/v3/users/5d25410e164f4a08b4013eeee09e10e2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:14.673834 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240488-61d7-4773-b9af-f3ca29eac9e0 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:14.683970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240488-61d7-4773-b9af-f3ca29eac9e0 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:14.744518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:14.745182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.745457 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.745729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] PATH_INFO: `/v3/projects/e37a473075e242d8b87b342636e12bb2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.747467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37a473075e242d8b87b342636e12bb2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:14.749553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:14.860925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37a473075e242d8b87b342636e12bb2', 'request_id': 'req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.862737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:14.867176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37a473075e242d8b87b342636e12bb2', 'request_id': 'req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.928614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37a473075e242d8b87b342636e12bb2', 'request_id': 'req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.939910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] The token cache is being invalidate because project e37a473075e242d8b87b342636e12bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:14.940600 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.941588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79206ea3-763b-4c43-9c5e-7f24d28e5b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:14.943174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1318/2651] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:14 2022] DELETE /identity/v3/projects/e37a473075e242d8b87b342636e12bb2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:14.948169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410d10b-b714-449b-b109-42d9e2858c8c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:14.948442 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410d10b-b714-449b-b109-42d9e2858c8c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:14.948713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410d10b-b714-449b-b109-42d9e2858c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:14.968545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9410d10b-b714-449b-b109-42d9e2858c8c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:14.969735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9410d10b-b714-449b-b109-42d9e2858c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:15.029123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1334/2652] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:15.036722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ecd61-0992-45cb-8ac9-6b8c492d448d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.037039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ecd61-0992-45cb-8ac9-6b8c492d448d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.037346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ecd61-0992-45cb-8ac9-6b8c492d448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.057514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-058ecd61-0992-45cb-8ac9-6b8c492d448d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:15.058710 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-058ecd61-0992-45cb-8ac9-6b8c492d448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:15.067096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1319/2653] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:15.071266 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410d10b-b714-449b-b109-42d9e2858c8c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.081297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410d10b-b714-449b-b109-42d9e2858c8c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.085917 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e58d1d-a963-42dd-be39-7940e70ed4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.086512 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e58d1d-a963-42dd-be39-7940e70ed4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.086790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e58d1d-a963-42dd-be39-7940e70ed4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.087065 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e58d1d-a963-42dd-be39-7940e70ed4c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.087709 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e58d1d-a963-42dd-be39-7940e70ed4c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:15.088045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e58d1d-a963-42dd-be39-7940e70ed4c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.089640 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e58d1d-a963-42dd-be39-7940e70ed4c6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.101590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1335/2654] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:15.105713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ecd61-0992-45cb-8ac9-6b8c492d448d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.115616 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ecd61-0992-45cb-8ac9-6b8c492d448d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.120231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094184ea-f19e-4324-a083-42f0f27ae6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.120826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094184ea-f19e-4324-a083-42f0f27ae6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.121105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094184ea-f19e-4324-a083-42f0f27ae6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.121379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094184ea-f19e-4324-a083-42f0f27ae6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.122039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094184ea-f19e-4324-a083-42f0f27ae6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.123958 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094184ea-f19e-4324-a083-42f0f27ae6c2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.210462 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1320/2655] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:15.214511 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e58d1d-a963-42dd-be39-7940e70ed4c6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.225176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e58d1d-a963-42dd-be39-7940e70ed4c6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.286848 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fd7d1-e615-473a-ae50-4dd8ee9f6358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.287449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fd7d1-e615-473a-ae50-4dd8ee9f6358 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.287725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fd7d1-e615-473a-ae50-4dd8ee9f6358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.288021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fd7d1-e615-473a-ae50-4dd8ee9f6358 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.288659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fd7d1-e615-473a-ae50-4dd8ee9f6358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.290553 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fd7d1-e615-473a-ae50-4dd8ee9f6358 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.298943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:15.363612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1336/2656] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:15.367704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094184ea-f19e-4324-a083-42f0f27ae6c2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.379324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094184ea-f19e-4324-a083-42f0f27ae6c2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.384112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf6234-5a62-4fa8-9d9c-67b32ccb287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.384790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf6234-5a62-4fa8-9d9c-67b32ccb287c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.385071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf6234-5a62-4fa8-9d9c-67b32ccb287c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.385347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf6234-5a62-4fa8-9d9c-67b32ccb287c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.386337 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf6234-5a62-4fa8-9d9c-67b32ccb287c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.388101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf6234-5a62-4fa8-9d9c-67b32ccb287c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.398330 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1321/2657] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:15.402492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fd7d1-e615-473a-ae50-4dd8ee9f6358 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.413900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fd7d1-e615-473a-ae50-4dd8ee9f6358 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.419136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a2702-a9a2-4df1-aa15-2e5eed7a944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.419722 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a2702-a9a2-4df1-aa15-2e5eed7a944a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.420033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a2702-a9a2-4df1-aa15-2e5eed7a944a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.420306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a2702-a9a2-4df1-aa15-2e5eed7a944a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.420944 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a2702-a9a2-4df1-aa15-2e5eed7a944a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.422540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a2702-a9a2-4df1-aa15-2e5eed7a944a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.433023 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1337/2658] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:15.438563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf6234-5a62-4fa8-9d9c-67b32ccb287c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.449127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf6234-5a62-4fa8-9d9c-67b32ccb287c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.454248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e815459-6c82-4a34-ad37-ea807986aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.454879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e815459-6c82-4a34-ad37-ea807986aab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.455295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e815459-6c82-4a34-ad37-ea807986aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.455567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e815459-6c82-4a34-ad37-ea807986aab3 admin admin] PATH_INFO: `/v3/projects/41bf9853cde24a2989042e98f143e7b0/users/3282e9e88e804cf1a5d33615b0f851c4/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.470884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e815459-6c82-4a34-ad37-ea807986aab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bf9853cde24a2989042e98f143e7b0, user_id=3282e9e88e804cf1a5d33615b0f851c4, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.473649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e815459-6c82-4a34-ad37-ea807986aab3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.541345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1322/2659] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:15 2022] PUT /identity/v3/projects/41bf9853cde24a2989042e98f143e7b0/users/3282e9e88e804cf1a5d33615b0f851c4/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:15.552598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2aaff-93bc-4d09-ba47-134e125d04d6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.552909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2aaff-93bc-4d09-ba47-134e125d04d6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.553189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2aaff-93bc-4d09-ba47-134e125d04d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.582625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-84e2aaff-93bc-4d09-ba47-134e125d04d6 None None] MFA Rules not processed for user `3282e9e88e804cf1a5d33615b0f851c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:15.583921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-84e2aaff-93bc-4d09-ba47-134e125d04d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:15.647979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1338/2660] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:15.652346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e815459-6c82-4a34-ad37-ea807986aab3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.714203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e815459-6c82-4a34-ad37-ea807986aab3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.719160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585d44b-fe58-4751-a16e-3e9baf977fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.719793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585d44b-fe58-4751-a16e-3e9baf977fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.720077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585d44b-fe58-4751-a16e-3e9baf977fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.720351 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585d44b-fe58-4751-a16e-3e9baf977fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.720982 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585d44b-fe58-4751-a16e-3e9baf977fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.723333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585d44b-fe58-4751-a16e-3e9baf977fc4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:15.841352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1323/2661] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:15.845587 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2aaff-93bc-4d09-ba47-134e125d04d6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:15.859159 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2aaff-93bc-4d09-ba47-134e125d04d6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:15.930956 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0e7cd-a44c-4a2e-ba90-7f0857a0abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:15.931475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0e7cd-a44c-4a2e-ba90-7f0857a0abe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:15.931769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0e7cd-a44c-4a2e-ba90-7f0857a0abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:15.932048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0e7cd-a44c-4a2e-ba90-7f0857a0abe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:15.932678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0e7cd-a44c-4a2e-ba90-7f0857a0abe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:15.934813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0e7cd-a44c-4a2e-ba90-7f0857a0abe1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.078528 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1339/2662] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:15 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:16.082905 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585d44b-fe58-4751-a16e-3e9baf977fc4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.093924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585d44b-fe58-4751-a16e-3e9baf977fc4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.098713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f133b-5325-4d98-8ae4-95bb543ff861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.099315 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f133b-5325-4d98-8ae4-95bb543ff861 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.099594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f133b-5325-4d98-8ae4-95bb543ff861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.099924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f133b-5325-4d98-8ae4-95bb543ff861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.100572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f133b-5325-4d98-8ae4-95bb543ff861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.102163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f133b-5325-4d98-8ae4-95bb543ff861 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.114333 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1324/2663] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:16.118636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0e7cd-a44c-4a2e-ba90-7f0857a0abe1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.128785 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0e7cd-a44c-4a2e-ba90-7f0857a0abe1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.133421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17950816-69e4-4c2c-8484-a98b8b95dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.134068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17950816-69e4-4c2c-8484-a98b8b95dae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.134345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17950816-69e4-4c2c-8484-a98b8b95dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.134621 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17950816-69e4-4c2c-8484-a98b8b95dae0 admin admin] PATH_INFO: `/v3/projects/49285602381b4ac5a6472dd84095f773/users/265bb111a16f49838332e1f80f3893bf/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.149788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17950816-69e4-4c2c-8484-a98b8b95dae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49285602381b4ac5a6472dd84095f773, user_id=265bb111a16f49838332e1f80f3893bf, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.152546 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17950816-69e4-4c2c-8484-a98b8b95dae0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.258010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1340/2664] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:16 2022] PUT /identity/v3/projects/49285602381b4ac5a6472dd84095f773/users/265bb111a16f49838332e1f80f3893bf/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:16.261987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f133b-5325-4d98-8ae4-95bb543ff861 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.276877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f133b-5325-4d98-8ae4-95bb543ff861 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.318355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:16.334241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdf2ae-c9cd-43a0-895f-ebf9ef2ac948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.334842 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf2ae-c9cd-43a0-895f-ebf9ef2ac948 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.335122 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf2ae-c9cd-43a0-895f-ebf9ef2ac948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.335395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf2ae-c9cd-43a0-895f-ebf9ef2ac948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.336057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdf2ae-c9cd-43a0-895f-ebf9ef2ac948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.337635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdf2ae-c9cd-43a0-895f-ebf9ef2ac948 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.348200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1325/2665] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:16.352287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17950816-69e4-4c2c-8484-a98b8b95dae0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.363306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17950816-69e4-4c2c-8484-a98b8b95dae0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.368120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbe7db-00e9-4722-a8aa-20b4d69fac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.368763 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbe7db-00e9-4722-a8aa-20b4d69fac7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.369037 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbe7db-00e9-4722-a8aa-20b4d69fac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.369305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbe7db-00e9-4722-a8aa-20b4d69fac7e admin admin] PATH_INFO: `/v3/projects/49285602381b4ac5a6472dd84095f773/users/265bb111a16f49838332e1f80f3893bf/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.371191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbe7db-00e9-4722-a8aa-20b4d69fac7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49285602381b4ac5a6472dd84095f773, user_id=265bb111a16f49838332e1f80f3893bf, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.374287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbe7db-00e9-4722-a8aa-20b4d69fac7e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.384392 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1341/2666] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:16 2022] PUT /identity/v3/projects/49285602381b4ac5a6472dd84095f773/users/265bb111a16f49838332e1f80f3893bf/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:16.394652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fecad-f4c2-44ef-812d-24019a56a11d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.394941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fecad-f4c2-44ef-812d-24019a56a11d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.395221 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fecad-f4c2-44ef-812d-24019a56a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.423926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-754fecad-f4c2-44ef-812d-24019a56a11d None None] MFA Rules not processed for user `265bb111a16f49838332e1f80f3893bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:16.425146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-754fecad-f4c2-44ef-812d-24019a56a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.495026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1326/2667] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:16.506911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbe7db-00e9-4722-a8aa-20b4d69fac7e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:16.508660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-52bbe7db-00e9-4722-a8aa-20b4d69fac7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:16.532551 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:16.570303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbe7db-00e9-4722-a8aa-20b4d69fac7e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:16.574377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd633b81-0c76-4fce-8047-dd86999dc3f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:16.575050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd633b81-0c76-4fce-8047-dd86999dc3f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:16.582157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd633b81-0c76-4fce-8047-dd86999dc3f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:16.582157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd633b81-0c76-4fce-8047-dd86999dc3f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:16.585891 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd633b81-0c76-4fce-8047-dd86999dc3f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:16.587578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd633b81-0c76-4fce-8047-dd86999dc3f5 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:16.598058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1342/2668] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:17.637746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fecad-f4c2-44ef-812d-24019a56a11d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:17.701929 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fecad-f4c2-44ef-812d-24019a56a11d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:17.706684 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:17.707305 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:17.707581 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:17.707907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] PATH_INFO: `/v3/users/3282e9e88e804cf1a5d33615b0f851c4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:17.709368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3282e9e88e804cf1a5d33615b0f851c4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:17.711272 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:17.839730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd633b81-0c76-4fce-8047-dd86999dc3f5 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:17.841881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cd633b81-0c76-4fce-8047-dd86999dc3f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:17.896956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3282e9e88e804cf1a5d33615b0f851c4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.904375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3282e9e88e804cf1a5d33615b0f851c4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.911975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:17.917131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3282e9e88e804cf1a5d33615b0f851c4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.917427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd633b81-0c76-4fce-8047-dd86999dc3f5 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:17.917828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3282e9e88e804cf1a5d33615b0f851c4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.918440 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55fa0bb6-244f-41ce-b6f2-a2a25b92c278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3282e9e88e804cf1a5d33615b0f851c4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:17.924927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:17.925542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:17.925827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:17.926125 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:17.929020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:17.986121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1327/2669] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:17 2022] DELETE /identity/v3/users/3282e9e88e804cf1a5d33615b0f851c4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:17.990403 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469bada-be34-4148-bbaa-6b206f592e83 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:17.994466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469bada-be34-4148-bbaa-6b206f592e83 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:17.994466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469bada-be34-4148-bbaa-6b206f592e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:17.994691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:17.995561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:18.008066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1343/2670] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:35:18.012756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6469bada-be34-4148-bbaa-6b206f592e83 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:18.014069 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6469bada-be34-4148-bbaa-6b206f592e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:18.076677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1328/2671] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:18.087007 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:18.091987 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:18.149045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef0ee-f0d1-4fcc-bed6-587b9fd5a074 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:18.161403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:18.202598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de71344-a95e-440b-9c4d-96c602582c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:18.203196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de71344-a95e-440b-9c4d-96c602582c73 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:18.203470 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de71344-a95e-440b-9c4d-96c602582c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:18.203738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de71344-a95e-440b-9c4d-96c602582c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:18.212986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de71344-a95e-440b-9c4d-96c602582c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:18.214411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de71344-a95e-440b-9c4d-96c602582c73 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:18.224417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1344/2672] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:18.685780 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469bada-be34-4148-bbaa-6b206f592e83 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:18.687671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6469bada-be34-4148-bbaa-6b206f592e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:18.700322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469bada-be34-4148-bbaa-6b206f592e83 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:18.706527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:18.707168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:18.707456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:18.707728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] PATH_INFO: `/v3/projects/41bf9853cde24a2989042e98f143e7b0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:18.709561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bf9853cde24a2989042e98f143e7b0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:18.712087 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:18.822234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bf9853cde24a2989042e98f143e7b0', 'request_id': 'req-344d8999-67da-43a0-9cd1-f29d04bccc59'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.829416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bf9853cde24a2989042e98f143e7b0', 'request_id': 'req-344d8999-67da-43a0-9cd1-f29d04bccc59'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.917095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bf9853cde24a2989042e98f143e7b0', 'request_id': 'req-344d8999-67da-43a0-9cd1-f29d04bccc59'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.928955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] The token cache is being invalidate because project 41bf9853cde24a2989042e98f143e7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:18.929179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.929793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:18.931266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1329/2673] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:18 2022] DELETE /identity/v3/projects/41bf9853cde24a2989042e98f143e7b0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:18.937690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de71344-a95e-440b-9c4d-96c602582c73 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:18.950398 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de71344-a95e-440b-9c4d-96c602582c73 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:19.008227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:19.008856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.009131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.009400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] PATH_INFO: `/v3/users/265bb111a16f49838332e1f80f3893bf` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.010503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265bb111a16f49838332e1f80f3893bf)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:19.012517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:19.211472 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265bb111a16f49838332e1f80f3893bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.212081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265bb111a16f49838332e1f80f3893bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.271534 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265bb111a16f49838332e1f80f3893bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.272178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265bb111a16f49838332e1f80f3893bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.285740 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4e39fffa-9176-48c8-a195-17f1d814f2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265bb111a16f49838332e1f80f3893bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.298537 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1345/2674] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:18 2022] DELETE /identity/v3/users/265bb111a16f49838332e1f80f3893bf => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:19.730476 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:19.732092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:19.745115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8999-67da-43a0-9cd1-f29d04bccc59 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:19.804910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:19.805537 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:19.805817 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:19.806090 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] PATH_INFO: `/v3/projects/49285602381b4ac5a6472dd84095f773` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:19.807209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=49285602381b4ac5a6472dd84095f773)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:19.809209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:19.817736 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:19.945984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49285602381b4ac5a6472dd84095f773', 'request_id': 'req-f71ef190-13a3-47ac-8499-622fa995ca1c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:19.952086 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49285602381b4ac5a6472dd84095f773', 'request_id': 'req-f71ef190-13a3-47ac-8499-622fa995ca1c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:20.043194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49285602381b4ac5a6472dd84095f773', 'request_id': 'req-f71ef190-13a3-47ac-8499-622fa995ca1c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:20.054016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] The token cache is being invalidate because project 49285602381b4ac5a6472dd84095f773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:20.054309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:20.058372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f71ef190-13a3-47ac-8499-622fa995ca1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:20.058372 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1330/2675] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:19 2022] DELETE /identity/v3/projects/49285602381b4ac5a6472dd84095f773 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:20.061335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52ba6-da7e-4fe9-a940-a05b0eda7544 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.061803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52ba6-da7e-4fe9-a940-a05b0eda7544 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.061909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52ba6-da7e-4fe9-a940-a05b0eda7544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.083062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e4e52ba6-da7e-4fe9-a940-a05b0eda7544 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:20.084305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e4e52ba6-da7e-4fe9-a940-a05b0eda7544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:20.116407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:20.144193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1346/2676] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:20.152000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b211-2a22-49a3-9c91-6e23af82ce51 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.152286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b211-2a22-49a3-9c91-6e23af82ce51 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.152563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b211-2a22-49a3-9c91-6e23af82ce51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.173346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b866b211-2a22-49a3-9c91-6e23af82ce51 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:20.174549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b866b211-2a22-49a3-9c91-6e23af82ce51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:20.182371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1331/2677] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:20.186670 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52ba6-da7e-4fe9-a940-a05b0eda7544 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.198119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52ba6-da7e-4fe9-a940-a05b0eda7544 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.203469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc393-ca69-4c23-9170-af89cb1c290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.204095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc393-ca69-4c23-9170-af89cb1c290f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.204370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc393-ca69-4c23-9170-af89cb1c290f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.204639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc393-ca69-4c23-9170-af89cb1c290f admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.205386 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc393-ca69-4c23-9170-af89cb1c290f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:20.205690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc393-ca69-4c23-9170-af89cb1c290f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.207351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc393-ca69-4c23-9170-af89cb1c290f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.219574 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1347/2678] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:20.224288 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b211-2a22-49a3-9c91-6e23af82ce51 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.233533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b211-2a22-49a3-9c91-6e23af82ce51 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.238400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aebba-d711-4472-ae81-c6d68277ddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.238993 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aebba-d711-4472-ae81-c6d68277ddb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.239270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aebba-d711-4472-ae81-c6d68277ddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.239543 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aebba-d711-4472-ae81-c6d68277ddb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.240216 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66aebba-d711-4472-ae81-c6d68277ddb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.242104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66aebba-d711-4472-ae81-c6d68277ddb7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.365290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1332/2679] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:20 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:20.369469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc393-ca69-4c23-9170-af89cb1c290f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.380815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc393-ca69-4c23-9170-af89cb1c290f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.437033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28d9a-9532-4809-9cb7-4763c3b312c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.438240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28d9a-9532-4809-9cb7-4763c3b312c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.438521 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28d9a-9532-4809-9cb7-4763c3b312c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.438819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28d9a-9532-4809-9cb7-4763c3b312c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.439417 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f28d9a-9532-4809-9cb7-4763c3b312c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.441654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f28d9a-9532-4809-9cb7-4763c3b312c4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.528784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1348/2680] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:20 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:20.532984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aebba-d711-4472-ae81-c6d68277ddb7 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.543881 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aebba-d711-4472-ae81-c6d68277ddb7 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.549103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5876f8-6b2e-47bf-bd98-7495cbf5bf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.549702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5876f8-6b2e-47bf-bd98-7495cbf5bf64 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.549981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5876f8-6b2e-47bf-bd98-7495cbf5bf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.550251 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5876f8-6b2e-47bf-bd98-7495cbf5bf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.550893 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5876f8-6b2e-47bf-bd98-7495cbf5bf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.552524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5876f8-6b2e-47bf-bd98-7495cbf5bf64 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.563163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1333/2681] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:20.567556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28d9a-9532-4809-9cb7-4763c3b312c4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.577557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28d9a-9532-4809-9cb7-4763c3b312c4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.582244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e111ea5-7e98-4e4d-8b9f-9abb39d7bd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.582829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e111ea5-7e98-4e4d-8b9f-9abb39d7bd0c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.583105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e111ea5-7e98-4e4d-8b9f-9abb39d7bd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.583374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e111ea5-7e98-4e4d-8b9f-9abb39d7bd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.584062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e111ea5-7e98-4e4d-8b9f-9abb39d7bd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.585659 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e111ea5-7e98-4e4d-8b9f-9abb39d7bd0c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.595998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1349/2682] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:20.600153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5876f8-6b2e-47bf-bd98-7495cbf5bf64 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.610781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5876f8-6b2e-47bf-bd98-7495cbf5bf64 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.615452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127810c0-021d-4fce-990c-3d36cfba8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.616070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127810c0-021d-4fce-990c-3d36cfba8e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.616344 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127810c0-021d-4fce-990c-3d36cfba8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.616610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127810c0-021d-4fce-990c-3d36cfba8e66 admin admin] PATH_INFO: `/v3/projects/e35dfa15b44d4c4683272beca9b5df89/users/7ccba8aa0ceb45b9a42172a969c059a3/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.631466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127810c0-021d-4fce-990c-3d36cfba8e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35dfa15b44d4c4683272beca9b5df89, user_id=7ccba8aa0ceb45b9a42172a969c059a3, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.634120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127810c0-021d-4fce-990c-3d36cfba8e66 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:20.710873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1334/2683] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:20 2022] PUT /identity/v3/projects/e35dfa15b44d4c4683272beca9b5df89/users/7ccba8aa0ceb45b9a42172a969c059a3/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:20.780381 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663bf1-7b24-4499-b437-d6f3afa0d1f8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.780672 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663bf1-7b24-4499-b437-d6f3afa0d1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.780957 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663bf1-7b24-4499-b437-d6f3afa0d1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.810999 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1f663bf1-7b24-4499-b437-d6f3afa0d1f8 None None] MFA Rules not processed for user `7ccba8aa0ceb45b9a42172a969c059a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:20.813082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1f663bf1-7b24-4499-b437-d6f3afa0d1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:20.879823 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1350/2684] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:20.883992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127810c0-021d-4fce-990c-3d36cfba8e66 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:20.956792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127810c0-021d-4fce-990c-3d36cfba8e66 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:20.963312 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ba9e9-674b-4349-8a07-d37770cd6e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:20.995788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ba9e9-674b-4349-8a07-d37770cd6e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:20.995788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ba9e9-674b-4349-8a07-d37770cd6e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:20.995788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ba9e9-674b-4349-8a07-d37770cd6e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:20.995788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ba9e9-674b-4349-8a07-d37770cd6e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:20.995788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ba9e9-674b-4349-8a07-d37770cd6e66 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.122128 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1335/2685] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:20 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:21.123233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f663bf1-7b24-4499-b437-d6f3afa0d1f8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.133936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f663bf1-7b24-4499-b437-d6f3afa0d1f8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.164475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:21.191125 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f0457-8a3f-4d99-8269-6b601fe93a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.191726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f0457-8a3f-4d99-8269-6b601fe93a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.192051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f0457-8a3f-4d99-8269-6b601fe93a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.192304 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f0457-8a3f-4d99-8269-6b601fe93a8c admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.192965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f0457-8a3f-4d99-8269-6b601fe93a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.194915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f0457-8a3f-4d99-8269-6b601fe93a8c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.294746 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1351/2686] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:21 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:21.298908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ba9e9-674b-4349-8a07-d37770cd6e66 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.309939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ba9e9-674b-4349-8a07-d37770cd6e66 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.314830 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0c105-9db2-43df-9760-8967bbd0ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.315428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0c105-9db2-43df-9760-8967bbd0ff17 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.315788 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0c105-9db2-43df-9760-8967bbd0ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.316118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0c105-9db2-43df-9760-8967bbd0ff17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.316763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0c105-9db2-43df-9760-8967bbd0ff17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.318357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0c105-9db2-43df-9760-8967bbd0ff17 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.330206 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1336/2687] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:21.335185 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f0457-8a3f-4d99-8269-6b601fe93a8c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.346203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f0457-8a3f-4d99-8269-6b601fe93a8c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.350975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87876276-ec78-4ed8-9b1e-8c667bfa21c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.351655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87876276-ec78-4ed8-9b1e-8c667bfa21c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.351964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87876276-ec78-4ed8-9b1e-8c667bfa21c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.352262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87876276-ec78-4ed8-9b1e-8c667bfa21c4 admin admin] PATH_INFO: `/v3/projects/87717856151c4922a7f881b4eb4a476c/users/88b74dc08f4943aebe6fd0102ef7efd6/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.367169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87876276-ec78-4ed8-9b1e-8c667bfa21c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87717856151c4922a7f881b4eb4a476c, user_id=88b74dc08f4943aebe6fd0102ef7efd6, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.369858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87876276-ec78-4ed8-9b1e-8c667bfa21c4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.483489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1352/2688] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:21 2022] PUT /identity/v3/projects/87717856151c4922a7f881b4eb4a476c/users/88b74dc08f4943aebe6fd0102ef7efd6/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:21.487563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0c105-9db2-43df-9760-8967bbd0ff17 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.498061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0c105-9db2-43df-9760-8967bbd0ff17 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.502264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:21.553797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba457-3ba9-4c96-b1c3-bb6c40a90f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.554402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba457-3ba9-4c96-b1c3-bb6c40a90f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.554678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba457-3ba9-4c96-b1c3-bb6c40a90f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.554948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba457-3ba9-4c96-b1c3-bb6c40a90f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.555582 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba457-3ba9-4c96-b1c3-bb6c40a90f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.557275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba457-3ba9-4c96-b1c3-bb6c40a90f05 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.567833 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1337/2689] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:21.577736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87876276-ec78-4ed8-9b1e-8c667bfa21c4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.583110 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87876276-ec78-4ed8-9b1e-8c667bfa21c4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.587812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550b6a7-3aec-4b7b-b893-c2a61dde8b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.588450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550b6a7-3aec-4b7b-b893-c2a61dde8b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.588724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550b6a7-3aec-4b7b-b893-c2a61dde8b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.588996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550b6a7-3aec-4b7b-b893-c2a61dde8b48 admin admin] PATH_INFO: `/v3/projects/87717856151c4922a7f881b4eb4a476c/users/88b74dc08f4943aebe6fd0102ef7efd6/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.591122 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550b6a7-3aec-4b7b-b893-c2a61dde8b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87717856151c4922a7f881b4eb4a476c, user_id=88b74dc08f4943aebe6fd0102ef7efd6, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.593822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550b6a7-3aec-4b7b-b893-c2a61dde8b48 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.605082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1353/2690] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:21 2022] PUT /identity/v3/projects/87717856151c4922a7f881b4eb4a476c/users/88b74dc08f4943aebe6fd0102ef7efd6/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:21.616162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e40414-38df-4aed-96cf-848688c31dc3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.616455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e40414-38df-4aed-96cf-848688c31dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.616734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e40414-38df-4aed-96cf-848688c31dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.646345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-02e40414-38df-4aed-96cf-848688c31dc3 None None] MFA Rules not processed for user `88b74dc08f4943aebe6fd0102ef7efd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:21.647539 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-02e40414-38df-4aed-96cf-848688c31dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:21.733804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1338/2691] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:21.746530 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550b6a7-3aec-4b7b-b893-c2a61dde8b48 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:21.756053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c550b6a7-3aec-4b7b-b893-c2a61dde8b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:21.809994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550b6a7-3aec-4b7b-b893-c2a61dde8b48 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:21.815294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067d72c-4e24-4e7c-ae75-8d0ebc7c2f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:21.815930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067d72c-4e24-4e7c-ae75-8d0ebc7c2f38 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:21.816201 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067d72c-4e24-4e7c-ae75-8d0ebc7c2f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:21.816464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067d72c-4e24-4e7c-ae75-8d0ebc7c2f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:21.825364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067d72c-4e24-4e7c-ae75-8d0ebc7c2f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:21.826782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067d72c-4e24-4e7c-ae75-8d0ebc7c2f38 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:21.836773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1354/2692] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:23.036990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e40414-38df-4aed-96cf-848688c31dc3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:23.046470 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e40414-38df-4aed-96cf-848688c31dc3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:23.051317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13940b-a60f-46b8-a339-f87b1d4cf8fe tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88b74dc08f4943aebe6fd0102ef7efd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87717856151c4922a7f881b4eb4a476c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:23.051990 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13940b-a60f-46b8-a339-f87b1d4cf8fe tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:23.052339 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13940b-a60f-46b8-a339-f87b1d4cf8fe tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:23.052620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13940b-a60f-46b8-a339-f87b1d4cf8fe tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:23.053298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13940b-a60f-46b8-a339-f87b1d4cf8fe tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:23.053602 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13940b-a60f-46b8-a339-f87b1d4cf8fe tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:23.055247 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13940b-a60f-46b8-a339-f87b1d4cf8fe tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:23.068077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1339/2693] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:23.071854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067d72c-4e24-4e7c-ae75-8d0ebc7c2f38 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:23.081817 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067d72c-4e24-4e7c-ae75-8d0ebc7c2f38 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:23.086346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f9e5a-1f7f-448e-a63e-b9598343c93d tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88b74dc08f4943aebe6fd0102ef7efd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87717856151c4922a7f881b4eb4a476c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:23.086937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f9e5a-1f7f-448e-a63e-b9598343c93d tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:23.087216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f9e5a-1f7f-448e-a63e-b9598343c93d tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:23.087487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f9e5a-1f7f-448e-a63e-b9598343c93d tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:23.088149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f9e5a-1f7f-448e-a63e-b9598343c93d tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:23.090020 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f9e5a-1f7f-448e-a63e-b9598343c93d tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:23.193703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1355/2694] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:23 2022] POST /identity/v3/projects => generated 354 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:23.197729 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13940b-a60f-46b8-a339-f87b1d4cf8fe tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:23.208585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13940b-a60f-46b8-a339-f87b1d4cf8fe tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:23.265783 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88b74dc08f4943aebe6fd0102ef7efd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87717856151c4922a7f881b4eb4a476c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:23.266393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:23.266704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:23.266981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:23.268377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:23.268618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:23.270208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:23.283025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1340/2695] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:23.321060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f9e5a-1f7f-448e-a63e-b9598343c93d tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:23.331447 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f9e5a-1f7f-448e-a63e-b9598343c93d tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:23.336033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88b74dc08f4943aebe6fd0102ef7efd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87717856151c4922a7f881b4eb4a476c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:23.336649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:23.336927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:23.337196 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] PATH_INFO: `/v3/projects/b6be71a98e6147a796bbcf49dc35f057` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:23.338396 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6be71a98e6147a796bbcf49dc35f057)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:23.340404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:23.491087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6be71a98e6147a796bbcf49dc35f057', 'request_id': 'req-cecd5ddd-d4ee-4b18-946a-11b7543dde35'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.498541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6be71a98e6147a796bbcf49dc35f057', 'request_id': 'req-cecd5ddd-d4ee-4b18-946a-11b7543dde35'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.504072 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:23.505220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6be71a98e6147a796bbcf49dc35f057', 'request_id': 'req-cecd5ddd-d4ee-4b18-946a-11b7543dde35'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.603316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] The token cache is being invalidate because project b6be71a98e6147a796bbcf49dc35f057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:23.603608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.604282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cecd5ddd-d4ee-4b18-946a-11b7543dde35 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:23.605784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1356/2696] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:23 2022] DELETE /identity/v3/projects/b6be71a98e6147a796bbcf49dc35f057 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:24.301477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.303370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.314259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:24.367286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c45e07-0130-4a35-ad0c-b13beee77aa3 tempest-VolumeQuotaClassesTest-1682556775 tempest-VolumeQuotaClassesTest-1682556775-project-admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.426044 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.428868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.428868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.428868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] PATH_INFO: `/v3/users/7ccba8aa0ceb45b9a42172a969c059a3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.428868 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ccba8aa0ceb45b9a42172a969c059a3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.430377 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.619231 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ccba8aa0ceb45b9a42172a969c059a3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.627894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ccba8aa0ceb45b9a42172a969c059a3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.640133 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ccba8aa0ceb45b9a42172a969c059a3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.640849 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ccba8aa0ceb45b9a42172a969c059a3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.641484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ccba8aa0ceb45b9a42172a969c059a3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:24.711196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1341/2697] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:24 2022] DELETE /identity/v3/users/7ccba8aa0ceb45b9a42172a969c059a3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:24.715668 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a20c7-9fc8-4a27-a859-2b7e653d0bce None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.716172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a20c7-9fc8-4a27-a859-2b7e653d0bce None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.716270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a20c7-9fc8-4a27-a859-2b7e653d0bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.735936 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ce4a20c7-9fc8-4a27-a859-2b7e653d0bce None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:24.737719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ce4a20c7-9fc8-4a27-a859-2b7e653d0bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.796287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1357/2698] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:24.806197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:24.807583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:24.849728 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:24.866143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bb5f3-3f25-43ec-82cb-1f52d1be3030 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:24.870041 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686017b-1307-4d6d-977b-fd2db4cbca7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:24.870640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686017b-1307-4d6d-977b-fd2db4cbca7f service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:24.870913 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686017b-1307-4d6d-977b-fd2db4cbca7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:24.871179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686017b-1307-4d6d-977b-fd2db4cbca7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:24.880259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686017b-1307-4d6d-977b-fd2db4cbca7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:24.881708 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686017b-1307-4d6d-977b-fd2db4cbca7f service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:24.895329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1342/2699] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:25.296271 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a20c7-9fc8-4a27-a859-2b7e653d0bce None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:25.297751 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ce4a20c7-9fc8-4a27-a859-2b7e653d0bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:25.310827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a20c7-9fc8-4a27-a859-2b7e653d0bce None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:25.316691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:25.317341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.317618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.317893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] PATH_INFO: `/v3/projects/e35dfa15b44d4c4683272beca9b5df89` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.319034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35dfa15b44d4c4683272beca9b5df89)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.321091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.442907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35dfa15b44d4c4683272beca9b5df89', 'request_id': 'req-91c249a8-ff67-4ade-93c3-2bf819798e9b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.449246 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35dfa15b44d4c4683272beca9b5df89', 'request_id': 'req-91c249a8-ff67-4ade-93c3-2bf819798e9b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.454697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35dfa15b44d4c4683272beca9b5df89', 'request_id': 'req-91c249a8-ff67-4ade-93c3-2bf819798e9b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.580024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] The token cache is being invalidate because project e35dfa15b44d4c4683272beca9b5df89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:25.580480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.587901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.587901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1358/2700] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:25 2022] DELETE /identity/v3/projects/e35dfa15b44d4c4683272beca9b5df89 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:25.589615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686017b-1307-4d6d-977b-fd2db4cbca7f service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:25.600134 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686017b-1307-4d6d-977b-fd2db4cbca7f service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:25.656585 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:25.657209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:25.657490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:25.657764 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] PATH_INFO: `/v3/users/88b74dc08f4943aebe6fd0102ef7efd6` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:25.659021 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b74dc08f4943aebe6fd0102ef7efd6)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:25.660955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:25.845062 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b74dc08f4943aebe6fd0102ef7efd6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.852415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b74dc08f4943aebe6fd0102ef7efd6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.864915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b74dc08f4943aebe6fd0102ef7efd6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.865624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b74dc08f4943aebe6fd0102ef7efd6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.866242 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f1f3761-79ad-4338-b0d7-08a3095813d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b74dc08f4943aebe6fd0102ef7efd6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:25.950219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1343/2701] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:25 2022] DELETE /identity/v3/users/88b74dc08f4943aebe6fd0102ef7efd6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:26.386964 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:26.388451 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:26.402193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c249a8-ff67-4ade-93c3-2bf819798e9b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:26.462364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:26.462996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:26.463269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:26.463541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] PATH_INFO: `/v3/projects/87717856151c4922a7f881b4eb4a476c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:26.464725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] RBAC: Authorizing `identity:delete_project(project_id=87717856151c4922a7f881b4eb4a476c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:26.466627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:26.482656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:26.569403 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87717856151c4922a7f881b4eb4a476c', 'request_id': 'req-32db682f-3422-43ab-9162-df62a81f160c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:26.575758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87717856151c4922a7f881b4eb4a476c', 'request_id': 'req-32db682f-3422-43ab-9162-df62a81f160c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:26.583294 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87717856151c4922a7f881b4eb4a476c', 'request_id': 'req-32db682f-3422-43ab-9162-df62a81f160c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:26.695087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] The token cache is being invalidate because project 87717856151c4922a7f881b4eb4a476c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:26.695493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:26.696214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32db682f-3422-43ab-9162-df62a81f160c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:26.697871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1359/2702] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:26 2022] DELETE /identity/v3/projects/87717856151c4922a7f881b4eb4a476c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:26.704876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833dd9-8385-4bf2-8da1-2a5317e64b94 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:26.705375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833dd9-8385-4bf2-8da1-2a5317e64b94 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:26.705501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833dd9-8385-4bf2-8da1-2a5317e64b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:26.730012 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0c833dd9-8385-4bf2-8da1-2a5317e64b94 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:26.730012 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0c833dd9-8385-4bf2-8da1-2a5317e64b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:26.779426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:26.788671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1344/2703] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:26.796508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111aec9-89ce-4eb6-9d4a-0948bd5e5e8a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:26.796816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111aec9-89ce-4eb6-9d4a-0948bd5e5e8a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:26.797086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111aec9-89ce-4eb6-9d4a-0948bd5e5e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:26.817870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4111aec9-89ce-4eb6-9d4a-0948bd5e5e8a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:26.821720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4111aec9-89ce-4eb6-9d4a-0948bd5e5e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:26.826924 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1360/2704] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:26.831876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c833dd9-8385-4bf2-8da1-2a5317e64b94 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:26.841386 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c833dd9-8385-4bf2-8da1-2a5317e64b94 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:26.845897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b20473-6b2b-4c38-ab9f-086fb6771452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:26.847008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b20473-6b2b-4c38-ab9f-086fb6771452 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:26.847286 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b20473-6b2b-4c38-ab9f-086fb6771452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:26.847588 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b20473-6b2b-4c38-ab9f-086fb6771452 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:26.848265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b20473-6b2b-4c38-ab9f-086fb6771452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:26.848583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b20473-6b2b-4c38-ab9f-086fb6771452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:26.850144 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b20473-6b2b-4c38-ab9f-086fb6771452 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:26.861869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1345/2705] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:26.866615 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111aec9-89ce-4eb6-9d4a-0948bd5e5e8a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:26.876535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111aec9-89ce-4eb6-9d4a-0948bd5e5e8a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:26.881485 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869374d-5cf3-47ab-b5cf-e796ff866110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:26.882022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869374d-5cf3-47ab-b5cf-e796ff866110 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:26.882299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869374d-5cf3-47ab-b5cf-e796ff866110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:26.882570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869374d-5cf3-47ab-b5cf-e796ff866110 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:26.883214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869374d-5cf3-47ab-b5cf-e796ff866110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:26.885147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869374d-5cf3-47ab-b5cf-e796ff866110 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:26.996361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1361/2706] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:26 2022] POST /identity/v3/projects => generated 409 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:26.998469 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b20473-6b2b-4c38-ab9f-086fb6771452 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:27.009759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b20473-6b2b-4c38-ab9f-086fb6771452 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:27.067368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c265c-a17b-4fd4-a970-780b398ffca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:27.068278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c265c-a17b-4fd4-a970-780b398ffca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.068551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c265c-a17b-4fd4-a970-780b398ffca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.068824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c265c-a17b-4fd4-a970-780b398ffca4 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.069560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c265c-a17b-4fd4-a970-780b398ffca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:27.071463 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c265c-a17b-4fd4-a970-780b398ffca4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:27.220739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1346/2707] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:26 2022] POST /identity/v3/users => generated 305 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:27.226602 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869374d-5cf3-47ab-b5cf-e796ff866110 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:27.240518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869374d-5cf3-47ab-b5cf-e796ff866110 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:27.247902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cad3c5-2bf8-4a5e-95a7-6f4ab3c4e64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:27.249087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cad3c5-2bf8-4a5e-95a7-6f4ab3c4e64a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.252019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cad3c5-2bf8-4a5e-95a7-6f4ab3c4e64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.252019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cad3c5-2bf8-4a5e-95a7-6f4ab3c4e64a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.252019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cad3c5-2bf8-4a5e-95a7-6f4ab3c4e64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:27.252337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cad3c5-2bf8-4a5e-95a7-6f4ab3c4e64a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:27.263826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1362/2708] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:27.267891 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c265c-a17b-4fd4-a970-780b398ffca4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:27.278731 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c265c-a17b-4fd4-a970-780b398ffca4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:27.284039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039b2d2-0dcc-4339-bcd5-fe2458262465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:27.284501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039b2d2-0dcc-4339-bcd5-fe2458262465 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.284754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039b2d2-0dcc-4339-bcd5-fe2458262465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.285060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039b2d2-0dcc-4339-bcd5-fe2458262465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.285746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039b2d2-0dcc-4339-bcd5-fe2458262465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:27.287376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039b2d2-0dcc-4339-bcd5-fe2458262465 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:27.298595 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1347/2709] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:27.303277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cad3c5-2bf8-4a5e-95a7-6f4ab3c4e64a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:27.313231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cad3c5-2bf8-4a5e-95a7-6f4ab3c4e64a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:27.318589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e843a-59e2-41f1-9622-29112de2792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:27.319232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e843a-59e2-41f1-9622-29112de2792f admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.319508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e843a-59e2-41f1-9622-29112de2792f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.319802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e843a-59e2-41f1-9622-29112de2792f admin admin] PATH_INFO: `/v3/projects/1830e83f59164091aee4333bbdca36bf/users/05a69495295b4b2fa2d42f220bf0d89d/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.334193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e843a-59e2-41f1-9622-29112de2792f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1830e83f59164091aee4333bbdca36bf, user_id=05a69495295b4b2fa2d42f220bf0d89d, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:27.336871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e843a-59e2-41f1-9622-29112de2792f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:27.431307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1363/2710] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:27 2022] PUT /identity/v3/projects/1830e83f59164091aee4333bbdca36bf/users/05a69495295b4b2fa2d42f220bf0d89d/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:27.442095 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bb595-79ac-4f87-8f5c-2c9e2bc862ba None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.442376 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bb595-79ac-4f87-8f5c-2c9e2bc862ba None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.442647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bb595-79ac-4f87-8f5c-2c9e2bc862ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.470456 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9d9bb595-79ac-4f87-8f5c-2c9e2bc862ba None None] MFA Rules not processed for user `05a69495295b4b2fa2d42f220bf0d89d`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:27.471783 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9d9bb595-79ac-4f87-8f5c-2c9e2bc862ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:27.535264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1348/2711] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:27 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:27.539771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e843a-59e2-41f1-9622-29112de2792f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:27.604996 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e843a-59e2-41f1-9622-29112de2792f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:27.610749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881abdcc-7ff9-4de4-8a6d-4c69a2f9e785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:27.611371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881abdcc-7ff9-4de4-8a6d-4c69a2f9e785 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.611643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881abdcc-7ff9-4de4-8a6d-4c69a2f9e785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.612697 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881abdcc-7ff9-4de4-8a6d-4c69a2f9e785 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.613349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881abdcc-7ff9-4de4-8a6d-4c69a2f9e785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:27.615822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881abdcc-7ff9-4de4-8a6d-4c69a2f9e785 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:27.713500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1364/2712] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:27 2022] POST /identity/v3/projects => generated 409 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:27.717630 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bb595-79ac-4f87-8f5c-2c9e2bc862ba None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:27.729125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bb595-79ac-4f87-8f5c-2c9e2bc862ba None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:27.777271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:27.786641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0bdf9-21f4-4b5e-8d77-cc7ae26d810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:27.787250 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0bdf9-21f4-4b5e-8d77-cc7ae26d810b admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.787531 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0bdf9-21f4-4b5e-8d77-cc7ae26d810b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.787835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0bdf9-21f4-4b5e-8d77-cc7ae26d810b admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.788475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0bdf9-21f4-4b5e-8d77-cc7ae26d810b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:27.790422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0bdf9-21f4-4b5e-8d77-cc7ae26d810b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:27.912645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1349/2713] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:27 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:27.916635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881abdcc-7ff9-4de4-8a6d-4c69a2f9e785 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:27.927384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881abdcc-7ff9-4de4-8a6d-4c69a2f9e785 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:27.932563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432c5a-43f0-4d6d-9677-375841b7bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:27.933195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432c5a-43f0-4d6d-9677-375841b7bc42 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.933478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432c5a-43f0-4d6d-9677-375841b7bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.933756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432c5a-43f0-4d6d-9677-375841b7bc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:27.934440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9432c5a-43f0-4d6d-9677-375841b7bc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:27.936091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9432c5a-43f0-4d6d-9677-375841b7bc42 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:27.951440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1365/2714] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:27.956280 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0bdf9-21f4-4b5e-8d77-cc7ae26d810b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:27.972323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0bdf9-21f4-4b5e-8d77-cc7ae26d810b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:27.986068 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aa165-4369-4c3f-85fa-7377a1325d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:27.986775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aa165-4369-4c3f-85fa-7377a1325d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:27.987200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aa165-4369-4c3f-85fa-7377a1325d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:27.987567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aa165-4369-4c3f-85fa-7377a1325d88 admin admin] PATH_INFO: `/v3/projects/e0193bb4b22f48298139020bbda0482a/users/c2cf44786138470280910aad0e3462be/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:28.003194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011aa165-4369-4c3f-85fa-7377a1325d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0193bb4b22f48298139020bbda0482a, user_id=c2cf44786138470280910aad0e3462be, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:28.005902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011aa165-4369-4c3f-85fa-7377a1325d88 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:28.088781 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1350/2715] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:27 2022] PUT /identity/v3/projects/e0193bb4b22f48298139020bbda0482a/users/c2cf44786138470280910aad0e3462be/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:28.092725 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432c5a-43f0-4d6d-9677-375841b7bc42 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:28.103525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432c5a-43f0-4d6d-9677-375841b7bc42 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:28.112250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:28.158121 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1b25a-fc34-401b-8ca8-0a0b5c476639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:28.158743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1b25a-fc34-401b-8ca8-0a0b5c476639 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:28.159059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1b25a-fc34-401b-8ca8-0a0b5c476639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:28.159325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1b25a-fc34-401b-8ca8-0a0b5c476639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:28.160080 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1b25a-fc34-401b-8ca8-0a0b5c476639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:28.161698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1b25a-fc34-401b-8ca8-0a0b5c476639 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:28.171095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1366/2716] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:28.175358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aa165-4369-4c3f-85fa-7377a1325d88 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:28.185656 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aa165-4369-4c3f-85fa-7377a1325d88 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:28.191153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da5d63-208c-47e1-a51c-fbb42960e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:28.191821 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5d63-208c-47e1-a51c-fbb42960e6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:28.192101 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5d63-208c-47e1-a51c-fbb42960e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:28.192370 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5d63-208c-47e1-a51c-fbb42960e6b2 admin admin] PATH_INFO: `/v3/projects/e0193bb4b22f48298139020bbda0482a/users/c2cf44786138470280910aad0e3462be/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:28.194270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da5d63-208c-47e1-a51c-fbb42960e6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0193bb4b22f48298139020bbda0482a, user_id=c2cf44786138470280910aad0e3462be, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:28.197003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da5d63-208c-47e1-a51c-fbb42960e6b2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:28.208395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1351/2717] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:28 2022] PUT /identity/v3/projects/e0193bb4b22f48298139020bbda0482a/users/c2cf44786138470280910aad0e3462be/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:28.218586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914dec9-a5eb-4d55-b987-f2f9df69b784 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:28.218872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914dec9-a5eb-4d55-b987-f2f9df69b784 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:28.219150 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914dec9-a5eb-4d55-b987-f2f9df69b784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:28.255033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e914dec9-a5eb-4d55-b987-f2f9df69b784 None None] MFA Rules not processed for user `c2cf44786138470280910aad0e3462be`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:28.255033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e914dec9-a5eb-4d55-b987-f2f9df69b784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:28.320521 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1367/2718] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:28 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:28.332302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da5d63-208c-47e1-a51c-fbb42960e6b2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:28.334035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e2da5d63-208c-47e1-a51c-fbb42960e6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:28.394385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da5d63-208c-47e1-a51c-fbb42960e6b2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:28.398465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6f42-0e3d-41c7-aaac-51eb2ea1bc35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:28.399218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6f42-0e3d-41c7-aaac-51eb2ea1bc35 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:28.399583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6f42-0e3d-41c7-aaac-51eb2ea1bc35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:28.399953 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6f42-0e3d-41c7-aaac-51eb2ea1bc35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:28.409389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6f42-0e3d-41c7-aaac-51eb2ea1bc35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:28.411162 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6f42-0e3d-41c7-aaac-51eb2ea1bc35 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:28.420792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1352/2719] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:28 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:28.829808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914dec9-a5eb-4d55-b987-f2f9df69b784 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:28.839881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914dec9-a5eb-4d55-b987-f2f9df69b784 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:28.843496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864bdf1-dc6a-4014-8dc1-e9ae3f833d11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:28.844127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bdf1-dc6a-4014-8dc1-e9ae3f833d11 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:28.844407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bdf1-dc6a-4014-8dc1-e9ae3f833d11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:28.844677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bdf1-dc6a-4014-8dc1-e9ae3f833d11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:28.901566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864bdf1-dc6a-4014-8dc1-e9ae3f833d11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:28.903047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864bdf1-dc6a-4014-8dc1-e9ae3f833d11 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:28.912898 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1368/2720] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:28 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:35.272831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef361-824a-4be5-9d8a-614c8d514f43 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:35.273572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef361-824a-4be5-9d8a-614c8d514f43 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:35.273572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ef361-824a-4be5-9d8a-614c8d514f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:35.292465 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ef7ef361-824a-4be5-9d8a-614c8d514f43 None None] MFA Rules not processed for user `ee53d2aaeaaf4ad796814293638123ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:35.293662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ef7ef361-824a-4be5-9d8a-614c8d514f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:35.348578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1353/2721] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:35.956498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864bdf1-dc6a-4014-8dc1-e9ae3f833d11 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:35.991420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:36.025781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864bdf1-dc6a-4014-8dc1-e9ae3f833d11 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.029449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.030336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.030458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.030735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] PATH_INFO: `/v3/users/05a69495295b4b2fa2d42f220bf0d89d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.032011 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a69495295b4b2fa2d42f220bf0d89d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.034093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.249879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a69495295b4b2fa2d42f220bf0d89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.250497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a69495295b4b2fa2d42f220bf0d89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.323040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a69495295b4b2fa2d42f220bf0d89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.324044 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a69495295b4b2fa2d42f220bf0d89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.336782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a69495295b4b2fa2d42f220bf0d89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:36.349491 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1369/2722] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:35 2022] DELETE /identity/v3/users/05a69495295b4b2fa2d42f220bf0d89d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:36.354117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f2003-bbce-4584-bf0a-d2c1e7bc4497 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.354637 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f2003-bbce-4584-bf0a-d2c1e7bc4497 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.354772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f2003-bbce-4584-bf0a-d2c1e7bc4497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.375016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b86f2003-bbce-4584-bf0a-d2c1e7bc4497 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:36.376257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b86f2003-bbce-4584-bf0a-d2c1e7bc4497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.427973 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:36.440444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1354/2723] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:36.450568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:36.452081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:36.511361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34a009-2454-4b8f-99ce-03295e802514 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:36.514895 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55d0d1-0d4a-4793-9f91-99835c87a0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:36.515496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55d0d1-0d4a-4793-9f91-99835c87a0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:36.515803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55d0d1-0d4a-4793-9f91-99835c87a0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:36.516075 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55d0d1-0d4a-4793-9f91-99835c87a0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:36.525188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55d0d1-0d4a-4793-9f91-99835c87a0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:36.526608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55d0d1-0d4a-4793-9f91-99835c87a0e2 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:36.536927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1370/2724] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:37.217293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f2003-bbce-4584-bf0a-d2c1e7bc4497 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.218761 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b86f2003-bbce-4584-bf0a-d2c1e7bc4497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:37.235847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f2003-bbce-4584-bf0a-d2c1e7bc4497 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.241000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.241670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.241944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.242341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] PATH_INFO: `/v3/projects/1830e83f59164091aee4333bbdca36bf` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.247784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1830e83f59164091aee4333bbdca36bf)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.249904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.357051 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1830e83f59164091aee4333bbdca36bf', 'request_id': 'req-501fa0cc-1849-4caf-8e67-30350c3864c6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.363071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1830e83f59164091aee4333bbdca36bf', 'request_id': 'req-501fa0cc-1849-4caf-8e67-30350c3864c6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.453004 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1830e83f59164091aee4333bbdca36bf', 'request_id': 'req-501fa0cc-1849-4caf-8e67-30350c3864c6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.465401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] The token cache is being invalidate because project 1830e83f59164091aee4333bbdca36bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:37.466151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.466804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.468676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1355/2725] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:37 2022] DELETE /identity/v3/projects/1830e83f59164091aee4333bbdca36bf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:37.473060 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55d0d1-0d4a-4793-9f91-99835c87a0e2 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:37.483358 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55d0d1-0d4a-4793-9f91-99835c87a0e2 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:37.534005 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:37.540803 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:37.541428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:37.541706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:37.541985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] PATH_INFO: `/v3/users/c2cf44786138470280910aad0e3462be` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:37.543101 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cf44786138470280910aad0e3462be)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:37.545219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:37.745293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cf44786138470280910aad0e3462be'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.745926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cf44786138470280910aad0e3462be'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.831048 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cf44786138470280910aad0e3462be'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.831692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cf44786138470280910aad0e3462be'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.844446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3d32772-86d2-471d-95e0-9adb7c7aca9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cf44786138470280910aad0e3462be'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:37.857306 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1371/2726] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:37 2022] DELETE /identity/v3/users/c2cf44786138470280910aad0e3462be => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:38.262501 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.264358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.283287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fa0cc-1849-4caf-8e67-30350c3864c6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.350483 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.351233 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.351512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.351806 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] PATH_INFO: `/v3/projects/e0193bb4b22f48298139020bbda0482a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.352920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0193bb4b22f48298139020bbda0482a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.354854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.487340 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0193bb4b22f48298139020bbda0482a', 'request_id': 'req-26e229c0-fce9-4a18-a42a-5580d85bc240'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.494207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0193bb4b22f48298139020bbda0482a', 'request_id': 'req-26e229c0-fce9-4a18-a42a-5580d85bc240'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.579704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0193bb4b22f48298139020bbda0482a', 'request_id': 'req-26e229c0-fce9-4a18-a42a-5580d85bc240'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.591117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] The token cache is being invalidate because project e0193bb4b22f48298139020bbda0482a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:38.591407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.592054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-26e229c0-fce9-4a18-a42a-5580d85bc240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:38.593542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1356/2727] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:38 2022] DELETE /identity/v3/projects/e0193bb4b22f48298139020bbda0482a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:38.599059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297b9b-50c0-4f9d-a8c2-4d5dc48e8979 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.599571 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297b9b-50c0-4f9d-a8c2-4d5dc48e8979 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.599836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297b9b-50c0-4f9d-a8c2-4d5dc48e8979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.621565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-71297b9b-50c0-4f9d-a8c2-4d5dc48e8979 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:38.622773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-71297b9b-50c0-4f9d-a8c2-4d5dc48e8979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.686575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1372/2728] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:38.696628 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252e72e-06a2-48d7-a584-7171b4917c9e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.696971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252e72e-06a2-48d7-a584-7171b4917c9e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.697284 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252e72e-06a2-48d7-a584-7171b4917c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.712183 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:38.717716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7252e72e-06a2-48d7-a584-7171b4917c9e None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:38.718910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7252e72e-06a2-48d7-a584-7171b4917c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:38.727310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1357/2729] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:38.731738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297b9b-50c0-4f9d-a8c2-4d5dc48e8979 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.742445 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297b9b-50c0-4f9d-a8c2-4d5dc48e8979 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.747038 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b57b87-3c69-4a75-9ef6-6be9d1304bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.747627 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b57b87-3c69-4a75-9ef6-6be9d1304bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.747939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b57b87-3c69-4a75-9ef6-6be9d1304bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.748216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b57b87-3c69-4a75-9ef6-6be9d1304bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.748858 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b57b87-3c69-4a75-9ef6-6be9d1304bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:38.749158 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b57b87-3c69-4a75-9ef6-6be9d1304bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.750749 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b57b87-3c69-4a75-9ef6-6be9d1304bc9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.763325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1373/2730] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:35:38.767658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252e72e-06a2-48d7-a584-7171b4917c9e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.777750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252e72e-06a2-48d7-a584-7171b4917c9e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.782342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64f9f5-b565-4262-913d-82b3771e9030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.783155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64f9f5-b565-4262-913d-82b3771e9030 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.783664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64f9f5-b565-4262-913d-82b3771e9030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.784153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64f9f5-b565-4262-913d-82b3771e9030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.785225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64f9f5-b565-4262-913d-82b3771e9030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.787164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64f9f5-b565-4262-913d-82b3771e9030 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.897065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1358/2731] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:38 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:38.901522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b57b87-3c69-4a75-9ef6-6be9d1304bc9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:38.912091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b57b87-3c69-4a75-9ef6-6be9d1304bc9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:38.986002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3d23a-33d2-45c2-86de-1d425d7c7bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:38.987501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3d23a-33d2-45c2-86de-1d425d7c7bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:38.987501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3d23a-33d2-45c2-86de-1d425d7c7bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:38.987501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3d23a-33d2-45c2-86de-1d425d7c7bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:38.987845 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3d23a-33d2-45c2-86de-1d425d7c7bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:38.990247 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3d23a-33d2-45c2-86de-1d425d7c7bb9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:38.999706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:39.141081 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1374/2732] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:38 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:35:39.146289 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64f9f5-b565-4262-913d-82b3771e9030 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.172564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64f9f5-b565-4262-913d-82b3771e9030 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.172564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e95c3b-e8fe-47cd-88cf-fbd0d72a1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.172564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95c3b-e8fe-47cd-88cf-fbd0d72a1d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.172564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95c3b-e8fe-47cd-88cf-fbd0d72a1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.173010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e95c3b-e8fe-47cd-88cf-fbd0d72a1d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.173010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e95c3b-e8fe-47cd-88cf-fbd0d72a1d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.173219 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e95c3b-e8fe-47cd-88cf-fbd0d72a1d2a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.186218 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1359/2733] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:39.191068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3d23a-33d2-45c2-86de-1d425d7c7bb9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.202928 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3d23a-33d2-45c2-86de-1d425d7c7bb9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.208267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73199fb1-a915-4ac9-be5d-3095ce706231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.209022 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199fb1-a915-4ac9-be5d-3095ce706231 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.209330 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199fb1-a915-4ac9-be5d-3095ce706231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.209605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199fb1-a915-4ac9-be5d-3095ce706231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.210297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73199fb1-a915-4ac9-be5d-3095ce706231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.212187 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73199fb1-a915-4ac9-be5d-3095ce706231 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.224315 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1375/2734] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:39.228640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e95c3b-e8fe-47cd-88cf-fbd0d72a1d2a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.240547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e95c3b-e8fe-47cd-88cf-fbd0d72a1d2a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.247936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98392723-3fb8-41cb-a088-06e5e461e5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.247936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98392723-3fb8-41cb-a088-06e5e461e5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.247936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98392723-3fb8-41cb-a088-06e5e461e5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.247936 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98392723-3fb8-41cb-a088-06e5e461e5dd admin admin] PATH_INFO: `/v3/projects/8cf561dcbf9f4b1480eec91a769efc79/users/de826c30bde24bf282e549de3b3054e1/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.266737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98392723-3fb8-41cb-a088-06e5e461e5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf561dcbf9f4b1480eec91a769efc79, user_id=de826c30bde24bf282e549de3b3054e1, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.269605 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98392723-3fb8-41cb-a088-06e5e461e5dd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.350060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1360/2735] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:39 2022] PUT /identity/v3/projects/8cf561dcbf9f4b1480eec91a769efc79/users/de826c30bde24bf282e549de3b3054e1/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:39.360541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc303d-b12e-48bf-8f15-64dd8aaf8ad9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.360818 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc303d-b12e-48bf-8f15-64dd8aaf8ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.361115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc303d-b12e-48bf-8f15-64dd8aaf8ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.396583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6afc303d-b12e-48bf-8f15-64dd8aaf8ad9 None None] MFA Rules not processed for user `de826c30bde24bf282e549de3b3054e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:39.398006 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6afc303d-b12e-48bf-8f15-64dd8aaf8ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:39.487427 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1376/2736] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:39.493028 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98392723-3fb8-41cb-a088-06e5e461e5dd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.570112 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98392723-3fb8-41cb-a088-06e5e461e5dd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.576735 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e946c-2b8e-4b30-97c2-5668bd75d52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.577348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e946c-2b8e-4b30-97c2-5668bd75d52f admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.577623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e946c-2b8e-4b30-97c2-5668bd75d52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.577895 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e946c-2b8e-4b30-97c2-5668bd75d52f admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.578706 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e946c-2b8e-4b30-97c2-5668bd75d52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.580678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e946c-2b8e-4b30-97c2-5668bd75d52f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.714879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1361/2737] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:39 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:39.718708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc303d-b12e-48bf-8f15-64dd8aaf8ad9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.730465 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc303d-b12e-48bf-8f15-64dd8aaf8ad9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.799805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4729c-6828-416d-8c27-4318b30865c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.800420 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4729c-6828-416d-8c27-4318b30865c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.800696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4729c-6828-416d-8c27-4318b30865c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.800977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4729c-6828-416d-8c27-4318b30865c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.802151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4729c-6828-416d-8c27-4318b30865c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.804114 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4729c-6828-416d-8c27-4318b30865c1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.894784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1377/2738] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:39 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:39.899014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e946c-2b8e-4b30-97c2-5668bd75d52f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.909607 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e946c-2b8e-4b30-97c2-5668bd75d52f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.914415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97023bbe-e1e4-4012-8a69-bd144ee60590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.915145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023bbe-e1e4-4012-8a69-bd144ee60590 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.915540 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023bbe-e1e4-4012-8a69-bd144ee60590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.915904 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023bbe-e1e4-4012-8a69-bd144ee60590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.916627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97023bbe-e1e4-4012-8a69-bd144ee60590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.918223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97023bbe-e1e4-4012-8a69-bd144ee60590 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:39.931271 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1362/2739] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:39.935547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4729c-6828-416d-8c27-4318b30865c1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:39.946675 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4729c-6828-416d-8c27-4318b30865c1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:39.951405 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c3c8-5c7b-4ddc-aaca-0cd6a81f3146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:39.952098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c3c8-5c7b-4ddc-aaca-0cd6a81f3146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:39.952384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c3c8-5c7b-4ddc-aaca-0cd6a81f3146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:39.952660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c3c8-5c7b-4ddc-aaca-0cd6a81f3146 admin admin] PATH_INFO: `/v3/projects/d496337b8479431b904aba534cd764fe/users/e6b32a5f722848b9921b5d1fcfef0d02/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:39.973836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6c3c8-5c7b-4ddc-aaca-0cd6a81f3146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d496337b8479431b904aba534cd764fe, user_id=e6b32a5f722848b9921b5d1fcfef0d02, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:39.974635 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6c3c8-5c7b-4ddc-aaca-0cd6a81f3146 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.089031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1378/2740] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:39 2022] PUT /identity/v3/projects/d496337b8479431b904aba534cd764fe/users/e6b32a5f722848b9921b5d1fcfef0d02/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:40.092971 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97023bbe-e1e4-4012-8a69-bd144ee60590 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:40.103923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97023bbe-e1e4-4012-8a69-bd144ee60590 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:40.163309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fa011-9414-4b4f-b6b0-1b047a8e5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:40.164279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fa011-9414-4b4f-b6b0-1b047a8e5a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.164279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fa011-9414-4b4f-b6b0-1b047a8e5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.164509 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fa011-9414-4b4f-b6b0-1b047a8e5a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.165316 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fa011-9414-4b4f-b6b0-1b047a8e5a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:40.167016 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fa011-9414-4b4f-b6b0-1b047a8e5a4e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.179165 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1363/2741] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:40.183736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c3c8-5c7b-4ddc-aaca-0cd6a81f3146 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:40.195188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c3c8-5c7b-4ddc-aaca-0cd6a81f3146 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:40.200452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830010b-22fc-4925-b178-c33828451cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:40.203979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830010b-22fc-4925-b178-c33828451cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.203979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830010b-22fc-4925-b178-c33828451cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.203979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830010b-22fc-4925-b178-c33828451cd6 admin admin] PATH_INFO: `/v3/projects/d496337b8479431b904aba534cd764fe/users/e6b32a5f722848b9921b5d1fcfef0d02/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.203979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830010b-22fc-4925-b178-c33828451cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d496337b8479431b904aba534cd764fe, user_id=e6b32a5f722848b9921b5d1fcfef0d02, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:40.206573 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830010b-22fc-4925-b178-c33828451cd6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.221069 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1379/2742] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:40 2022] PUT /identity/v3/projects/d496337b8479431b904aba534cd764fe/users/e6b32a5f722848b9921b5d1fcfef0d02/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:35:40.231841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9426cd-0f53-466b-ab15-3f71f3f45ff9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.232214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9426cd-0f53-466b-ab15-3f71f3f45ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.232560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9426cd-0f53-466b-ab15-3f71f3f45ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.267945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:40.272210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-db9426cd-0f53-466b-ab15-3f71f3f45ff9 None None] MFA Rules not processed for user `e6b32a5f722848b9921b5d1fcfef0d02`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:40.273558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-db9426cd-0f53-466b-ab15-3f71f3f45ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:40.351946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1364/2743] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:40.359560 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830010b-22fc-4925-b178-c33828451cd6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:40.365311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d830010b-22fc-4925-b178-c33828451cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:40.397850 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:40.442130 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830010b-22fc-4925-b178-c33828451cd6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:40.447347 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfe884-295d-48b0-9c80-82a4ae103e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:40.447998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfe884-295d-48b0-9c80-82a4ae103e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:40.448444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfe884-295d-48b0-9c80-82a4ae103e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:40.449042 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfe884-295d-48b0-9c80-82a4ae103e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:40.650449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfe884-295d-48b0-9c80-82a4ae103e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:40.652181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfe884-295d-48b0-9c80-82a4ae103e5e service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:40.663210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1380/2744] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:48.175805 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9426cd-0f53-466b-ab15-3f71f3f45ff9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:48.177349 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-db9426cd-0f53-466b-ab15-3f71f3f45ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:48.190230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9426cd-0f53-466b-ab15-3f71f3f45ff9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:48.194634 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628c84e-bf11-4c71-9a6b-1698d9890258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:48.195253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628c84e-bf11-4c71-9a6b-1698d9890258 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:48.195557 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628c84e-bf11-4c71-9a6b-1698d9890258 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:48.195862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628c84e-bf11-4c71-9a6b-1698d9890258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:48.205725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628c84e-bf11-4c71-9a6b-1698d9890258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:48.207983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628c84e-bf11-4c71-9a6b-1698d9890258 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:48.218435 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1365/2745] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:50.657686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=38 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:54.289931 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfe884-295d-48b0-9c80-82a4ae103e5e service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:54.353105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfe884-295d-48b0-9c80-82a4ae103e5e service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:54.357616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:54.358228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:54.358501 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:54.358769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] PATH_INFO: `/v3/users/de826c30bde24bf282e549de3b3054e1` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:54.359968 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de826c30bde24bf282e549de3b3054e1)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:54.361847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:54.501609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de826c30bde24bf282e549de3b3054e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.502284 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de826c30bde24bf282e549de3b3054e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.568168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de826c30bde24bf282e549de3b3054e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.568851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de826c30bde24bf282e549de3b3054e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.582098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de826c30bde24bf282e549de3b3054e1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:54.596051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1381/2746] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:54 2022] DELETE /identity/v3/users/de826c30bde24bf282e549de3b3054e1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:54.601410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab363e8-3c90-4cdd-ab6a-023878f64163 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:54.601911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab363e8-3c90-4cdd-ab6a-023878f64163 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:54.602018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab363e8-3c90-4cdd-ab6a-023878f64163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:54.621061 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-aab363e8-3c90-4cdd-ab6a-023878f64163 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:54.622243 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aab363e8-3c90-4cdd-ab6a-023878f64163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:54.681149 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1366/2747] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:54.691142 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:54.692576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:54.751542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92904dd8-6e1d-4e1b-8c9c-f9c8bd3c32f2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:54.755189 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8673c-8bd3-41b8-86f4-334f61d23477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:54.756335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8673c-8bd3-41b8-86f4-334f61d23477 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:54.756606 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8673c-8bd3-41b8-86f4-334f61d23477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:54.756877 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8673c-8bd3-41b8-86f4-334f61d23477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:54.766301 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8673c-8bd3-41b8-86f4-334f61d23477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:54.767730 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8673c-8bd3-41b8-86f4-334f61d23477 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:54.778025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1382/2748] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:35:55.158259 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab363e8-3c90-4cdd-ab6a-023878f64163 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:55.163287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aab363e8-3c90-4cdd-ab6a-023878f64163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:55.174632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab363e8-3c90-4cdd-ab6a-023878f64163 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:55.180174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:55.180810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:55.181088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:55.181358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] PATH_INFO: `/v3/projects/8cf561dcbf9f4b1480eec91a769efc79` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:55.182558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf561dcbf9f4b1480eec91a769efc79)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:55.184511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:55.271633 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf561dcbf9f4b1480eec91a769efc79', 'request_id': 'req-55a664ec-00f4-4de0-b11a-869c1e51991d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.278000 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf561dcbf9f4b1480eec91a769efc79', 'request_id': 'req-55a664ec-00f4-4de0-b11a-869c1e51991d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.390143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf561dcbf9f4b1480eec91a769efc79', 'request_id': 'req-55a664ec-00f4-4de0-b11a-869c1e51991d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.401155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] The token cache is being invalidate because project 8cf561dcbf9f4b1480eec91a769efc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:55.401381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.402003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.403485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1367/2749] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:55 2022] DELETE /identity/v3/projects/8cf561dcbf9f4b1480eec91a769efc79 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:55.407576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8673c-8bd3-41b8-86f4-334f61d23477 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:55.417718 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8673c-8bd3-41b8-86f4-334f61d23477 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:55.436642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:55.474927 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:55.475651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:55.475954 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:55.476222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] PATH_INFO: `/v3/users/e6b32a5f722848b9921b5d1fcfef0d02` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:55.477336 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b32a5f722848b9921b5d1fcfef0d02)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:55.479237 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:55.655726 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b32a5f722848b9921b5d1fcfef0d02'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.656349 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b32a5f722848b9921b5d1fcfef0d02'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.722206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b32a5f722848b9921b5d1fcfef0d02'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.722831 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b32a5f722848b9921b5d1fcfef0d02'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.736083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a1ecc15d-0d42-4be4-aa55-1ed7bc144038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b32a5f722848b9921b5d1fcfef0d02'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:55.748776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1383/2750] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:35:55 2022] DELETE /identity/v3/users/e6b32a5f722848b9921b5d1fcfef0d02 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:56.158060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.159636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:56.174783 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a664ec-00f4-4de0-b11a-869c1e51991d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.180176 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:56.240405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.241074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.241356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.241632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] PATH_INFO: `/v3/projects/d496337b8479431b904aba534cd764fe` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.242766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d496337b8479431b904aba534cd764fe)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.244711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.340721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd496337b8479431b904aba534cd764fe', 'request_id': 'req-48626396-59ac-4d0b-8f4d-b0404607b002'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.346903 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd496337b8479431b904aba534cd764fe', 'request_id': 'req-48626396-59ac-4d0b-8f4d-b0404607b002'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.396786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd496337b8479431b904aba534cd764fe', 'request_id': 'req-48626396-59ac-4d0b-8f4d-b0404607b002'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.408555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] The token cache is being invalidate because project d496337b8479431b904aba534cd764fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:35:56.414031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.414031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48626396-59ac-4d0b-8f4d-b0404607b002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:35:56.414031 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1368/2751] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:35:56 2022] DELETE /identity/v3/projects/d496337b8479431b904aba534cd764fe => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:56.416991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51d599-9126-436b-be93-58e80ed30488 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.417454 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51d599-9126-436b-be93-58e80ed30488 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.417560 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51d599-9126-436b-be93-58e80ed30488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.439019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ae51d599-9126-436b-be93-58e80ed30488 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:56.439019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae51d599-9126-436b-be93-58e80ed30488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:56.500795 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1384/2752] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:56.515072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e42df-7dab-4a3a-8f1f-ec28d3f2803c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.515355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e42df-7dab-4a3a-8f1f-ec28d3f2803c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.515627 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e42df-7dab-4a3a-8f1f-ec28d3f2803c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.536011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8c1e42df-7dab-4a3a-8f1f-ec28d3f2803c None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:56.537502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8c1e42df-7dab-4a3a-8f1f-ec28d3f2803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:56.549148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1369/2753] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:35:56.553829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51d599-9126-436b-be93-58e80ed30488 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.566632 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51d599-9126-436b-be93-58e80ed30488 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.573865 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bb079-c5c7-4160-a1fb-8f0622f09d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.574689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb079-c5c7-4160-a1fb-8f0622f09d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.575079 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb079-c5c7-4160-a1fb-8f0622f09d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.575351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb079-c5c7-4160-a1fb-8f0622f09d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.576025 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bb079-c5c7-4160-a1fb-8f0622f09d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:35:56.576322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bb079-c5c7-4160-a1fb-8f0622f09d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.577920 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bb079-c5c7-4160-a1fb-8f0622f09d2b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.589458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1385/2754] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:35:56.593843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e42df-7dab-4a3a-8f1f-ec28d3f2803c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.603287 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e42df-7dab-4a3a-8f1f-ec28d3f2803c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.608131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ba2cb-06da-4e15-aa11-32ea4eae6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.608720 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ba2cb-06da-4e15-aa11-32ea4eae6f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.608999 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ba2cb-06da-4e15-aa11-32ea4eae6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.609296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ba2cb-06da-4e15-aa11-32ea4eae6f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.609917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ba2cb-06da-4e15-aa11-32ea4eae6f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.611869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ba2cb-06da-4e15-aa11-32ea4eae6f64 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.695604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1370/2755] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:56.699674 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bb079-c5c7-4160-a1fb-8f0622f09d2b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.710255 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bb079-c5c7-4160-a1fb-8f0622f09d2b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.735733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:56.766972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5819b-1d6b-4f84-90b8-aacee43b7864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.771426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5819b-1d6b-4f84-90b8-aacee43b7864 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.771426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5819b-1d6b-4f84-90b8-aacee43b7864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.771426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5819b-1d6b-4f84-90b8-aacee43b7864 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.771426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5819b-1d6b-4f84-90b8-aacee43b7864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.771426 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5819b-1d6b-4f84-90b8-aacee43b7864 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.900319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1386/2756] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:56 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:56.904381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ba2cb-06da-4e15-aa11-32ea4eae6f64 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.915083 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ba2cb-06da-4e15-aa11-32ea4eae6f64 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.919727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8e04-e345-4d5f-9efd-d5549fbf11f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.921492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8e04-e345-4d5f-9efd-d5549fbf11f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.921492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8e04-e345-4d5f-9efd-d5549fbf11f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.921492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8e04-e345-4d5f-9efd-d5549fbf11f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.921492 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a8e04-e345-4d5f-9efd-d5549fbf11f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.923052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a8e04-e345-4d5f-9efd-d5549fbf11f5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.933651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1371/2757] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:56.937572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5819b-1d6b-4f84-90b8-aacee43b7864 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.948703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5819b-1d6b-4f84-90b8-aacee43b7864 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.953400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff38258-5165-4eaf-9318-7954e41ced44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.953984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff38258-5165-4eaf-9318-7954e41ced44 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.954260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff38258-5165-4eaf-9318-7954e41ced44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.954525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff38258-5165-4eaf-9318-7954e41ced44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:56.955154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff38258-5165-4eaf-9318-7954e41ced44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:56.957119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff38258-5165-4eaf-9318-7954e41ced44 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:56.968481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1387/2758] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:56.972586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8e04-e345-4d5f-9efd-d5549fbf11f5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:56.982724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8e04-e345-4d5f-9efd-d5549fbf11f5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:56.987191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d18589-a9e1-457b-8e97-78534638bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:56.987858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d18589-a9e1-457b-8e97-78534638bbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:56.988142 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d18589-a9e1-457b-8e97-78534638bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:56.988415 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d18589-a9e1-457b-8e97-78534638bbbc admin admin] PATH_INFO: `/v3/projects/75e4353827b14df39428e7a229fd1567/users/2ea0faaa52d147068cd6af8662d7feab/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.002743 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d18589-a9e1-457b-8e97-78534638bbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e4353827b14df39428e7a229fd1567, user_id=2ea0faaa52d147068cd6af8662d7feab, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.005423 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d18589-a9e1-457b-8e97-78534638bbbc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.089410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1372/2759] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:56 2022] PUT /identity/v3/projects/75e4353827b14df39428e7a229fd1567/users/2ea0faaa52d147068cd6af8662d7feab/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:57.101168 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95570c-4d40-4069-a443-374c398c0096 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.101450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95570c-4d40-4069-a443-374c398c0096 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.101742 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95570c-4d40-4069-a443-374c398c0096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.129175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7d95570c-4d40-4069-a443-374c398c0096 None None] MFA Rules not processed for user `2ea0faaa52d147068cd6af8662d7feab`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:57.130365 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7d95570c-4d40-4069-a443-374c398c0096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:57.197292 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1388/2760] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:57.201956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d18589-a9e1-457b-8e97-78534638bbbc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:57.241535 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:57.264475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d18589-a9e1-457b-8e97-78534638bbbc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:57.269208 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3f0e-3a6d-495c-b373-154544881257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:57.269794 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3f0e-3a6d-495c-b373-154544881257 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.270073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3f0e-3a6d-495c-b373-154544881257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.270346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3f0e-3a6d-495c-b373-154544881257 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.270997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3f0e-3a6d-495c-b373-154544881257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.273623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3f0e-3a6d-495c-b373-154544881257 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.397739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1373/2761] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:57 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:57.401776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95570c-4d40-4069-a443-374c398c0096 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:57.412448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95570c-4d40-4069-a443-374c398c0096 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:57.468604 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f09f3-72d2-4e68-b9e7-687af1892dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:57.469231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f09f3-72d2-4e68-b9e7-687af1892dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.469436 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f09f3-72d2-4e68-b9e7-687af1892dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.469745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f09f3-72d2-4e68-b9e7-687af1892dcf admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.470379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f09f3-72d2-4e68-b9e7-687af1892dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.472317 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f09f3-72d2-4e68-b9e7-687af1892dcf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.569047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1389/2762] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:57 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:57.573306 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3f0e-3a6d-495c-b373-154544881257 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:57.583866 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3f0e-3a6d-495c-b373-154544881257 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:57.588564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5eb91-56aa-4281-9f38-4ef818147455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:57.589166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5eb91-56aa-4281-9f38-4ef818147455 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.589469 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5eb91-56aa-4281-9f38-4ef818147455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.589746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5eb91-56aa-4281-9f38-4ef818147455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.590414 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5eb91-56aa-4281-9f38-4ef818147455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.592050 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5eb91-56aa-4281-9f38-4ef818147455 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.602753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1374/2763] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:57.606707 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f09f3-72d2-4e68-b9e7-687af1892dcf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:57.617493 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f09f3-72d2-4e68-b9e7-687af1892dcf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:57.622338 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a72651-63d5-44b0-8ec0-58e01d728791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:57.622930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a72651-63d5-44b0-8ec0-58e01d728791 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.623208 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a72651-63d5-44b0-8ec0-58e01d728791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.623522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a72651-63d5-44b0-8ec0-58e01d728791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.624198 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a72651-63d5-44b0-8ec0-58e01d728791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.625776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a72651-63d5-44b0-8ec0-58e01d728791 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.636453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1390/2764] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:57.640671 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5eb91-56aa-4281-9f38-4ef818147455 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:57.651288 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5eb91-56aa-4281-9f38-4ef818147455 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:57.655896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703af395-41bc-400b-a31c-eabcf349e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:57.656538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af395-41bc-400b-a31c-eabcf349e783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.656837 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af395-41bc-400b-a31c-eabcf349e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.657096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af395-41bc-400b-a31c-eabcf349e783 admin admin] PATH_INFO: `/v3/projects/81fa932c3203475f932427c6e03e6b6a/users/b57cde6570234664bad3f4a810dcacc2/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.672262 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703af395-41bc-400b-a31c-eabcf349e783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fa932c3203475f932427c6e03e6b6a, user_id=b57cde6570234664bad3f4a810dcacc2, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.674912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703af395-41bc-400b-a31c-eabcf349e783 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:57.745976 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1375/2765] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:57 2022] PUT /identity/v3/projects/81fa932c3203475f932427c6e03e6b6a/users/b57cde6570234664bad3f4a810dcacc2/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:57.757244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8bf6c-e9d0-4ed0-8c57-f52cd395dae0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.757531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8bf6c-e9d0-4ed0-8c57-f52cd395dae0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.757806 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8bf6c-e9d0-4ed0-8c57-f52cd395dae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.785582 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-70d8bf6c-e9d0-4ed0-8c57-f52cd395dae0 None None] MFA Rules not processed for user `b57cde6570234664bad3f4a810dcacc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:57.786837 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-70d8bf6c-e9d0-4ed0-8c57-f52cd395dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:57.791282 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:57.852084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1391/2766] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:57.856545 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703af395-41bc-400b-a31c-eabcf349e783 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:57.922296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703af395-41bc-400b-a31c-eabcf349e783 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:57.926938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7947-de65-408e-8490-730d5e14e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:57.927624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7947-de65-408e-8490-730d5e14e389 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:57.928474 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7947-de65-408e-8490-730d5e14e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:57.928742 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7947-de65-408e-8490-730d5e14e389 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:57.929392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d7947-de65-408e-8490-730d5e14e389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:57.931300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d7947-de65-408e-8490-730d5e14e389 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:58.014795 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1376/2767] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:35:57 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:58.018865 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8bf6c-e9d0-4ed0-8c57-f52cd395dae0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:58.030544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8bf6c-e9d0-4ed0-8c57-f52cd395dae0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:58.086556 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae929ba5-bf46-4f17-8eaf-c478b6c4b724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:58.087156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae929ba5-bf46-4f17-8eaf-c478b6c4b724 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:58.087429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae929ba5-bf46-4f17-8eaf-c478b6c4b724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:58.087695 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae929ba5-bf46-4f17-8eaf-c478b6c4b724 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:58.088350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae929ba5-bf46-4f17-8eaf-c478b6c4b724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:58.090251 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae929ba5-bf46-4f17-8eaf-c478b6c4b724 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:58.156154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1392/2768] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:35:58 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:35:58.160209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7947-de65-408e-8490-730d5e14e389 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:58.170666 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7947-de65-408e-8490-730d5e14e389 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:58.175478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec8a96-c568-47b4-9101-c69881b68011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:58.176110 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec8a96-c568-47b4-9101-c69881b68011 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:58.176392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec8a96-c568-47b4-9101-c69881b68011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:58.176665 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec8a96-c568-47b4-9101-c69881b68011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:58.177310 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec8a96-c568-47b4-9101-c69881b68011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:58.179757 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec8a96-c568-47b4-9101-c69881b68011 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:58.195421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1377/2769] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:35:58.199624 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae929ba5-bf46-4f17-8eaf-c478b6c4b724 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:58.210280 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae929ba5-bf46-4f17-8eaf-c478b6c4b724 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:58.215058 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891761d-0606-4d09-9255-6074def5a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:58.215698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891761d-0606-4d09-9255-6074def5a4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:58.216011 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891761d-0606-4d09-9255-6074def5a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:58.216283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891761d-0606-4d09-9255-6074def5a4f3 admin admin] PATH_INFO: `/v3/projects/49b92182a7484ec2b844363551da8f59/users/63499eaf11814c48a0a58f0bc9a8b338/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:58.230769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891761d-0606-4d09-9255-6074def5a4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b92182a7484ec2b844363551da8f59, user_id=63499eaf11814c48a0a58f0bc9a8b338, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:58.233437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891761d-0606-4d09-9255-6074def5a4f3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:58.310719 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1393/2770] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:58 2022] PUT /identity/v3/projects/49b92182a7484ec2b844363551da8f59/users/63499eaf11814c48a0a58f0bc9a8b338/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:58.314677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec8a96-c568-47b4-9101-c69881b68011 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:58.325620 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec8a96-c568-47b4-9101-c69881b68011 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:58.381921 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7e6b-1a4e-4252-8d20-e4f80210961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:58.382542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7e6b-1a4e-4252-8d20-e4f80210961c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:58.382819 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7e6b-1a4e-4252-8d20-e4f80210961c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:58.383091 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7e6b-1a4e-4252-8d20-e4f80210961c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:58.383767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7e6b-1a4e-4252-8d20-e4f80210961c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:58.385357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7e6b-1a4e-4252-8d20-e4f80210961c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:58.386559 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:58.395275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1378/2771] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:35:58.400076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891761d-0606-4d09-9255-6074def5a4f3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:58.410486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891761d-0606-4d09-9255-6074def5a4f3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:58.415830 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8992b73-a1f4-44a4-a176-96df59f4b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:58.416478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8992b73-a1f4-44a4-a176-96df59f4b08e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:58.416754 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8992b73-a1f4-44a4-a176-96df59f4b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:58.417028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8992b73-a1f4-44a4-a176-96df59f4b08e admin admin] PATH_INFO: `/v3/projects/49b92182a7484ec2b844363551da8f59/users/63499eaf11814c48a0a58f0bc9a8b338/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:58.418934 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8992b73-a1f4-44a4-a176-96df59f4b08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b92182a7484ec2b844363551da8f59, user_id=63499eaf11814c48a0a58f0bc9a8b338, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:58.421791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8992b73-a1f4-44a4-a176-96df59f4b08e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:58.432976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1394/2772] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:35:58 2022] PUT /identity/v3/projects/49b92182a7484ec2b844363551da8f59/users/63499eaf11814c48a0a58f0bc9a8b338/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:35:58.443617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dcc0b-53d7-44cd-9688-4feb036eed0a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:58.443948 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dcc0b-53d7-44cd-9688-4feb036eed0a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:58.444255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dcc0b-53d7-44cd-9688-4feb036eed0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:58.472130 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-416dcc0b-53d7-44cd-9688-4feb036eed0a None None] MFA Rules not processed for user `63499eaf11814c48a0a58f0bc9a8b338`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:35:58.473331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-416dcc0b-53d7-44cd-9688-4feb036eed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:58.545422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1379/2773] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:35:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:35:58.560811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8992b73-a1f4-44a4-a176-96df59f4b08e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:35:58.562543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e8992b73-a1f4-44a4-a176-96df59f4b08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:35:58.624878 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8992b73-a1f4-44a4-a176-96df59f4b08e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:35:58.628480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454545c-4176-463e-bb57-50f6262b302c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:35:58.629071 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454545c-4176-463e-bb57-50f6262b302c service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:35:58.629344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454545c-4176-463e-bb57-50f6262b302c service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:35:58.629610 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454545c-4176-463e-bb57-50f6262b302c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:35:58.638629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:58.685524 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454545c-4176-463e-bb57-50f6262b302c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:35:58.686952 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454545c-4176-463e-bb57-50f6262b302c service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:35:58.697148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1395/2774] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:35:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:36:00.567698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dcc0b-53d7-44cd-9688-4feb036eed0a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:00.569120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-416dcc0b-53d7-44cd-9688-4feb036eed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:00.584167 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dcc0b-53d7-44cd-9688-4feb036eed0a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:00.588669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef0b5b-ba0a-4df3-8581-0e4e3d26824f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:00.589341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef0b5b-ba0a-4df3-8581-0e4e3d26824f service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:00.589889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef0b5b-ba0a-4df3-8581-0e4e3d26824f service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:00.590389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef0b5b-ba0a-4df3-8581-0e4e3d26824f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:00.650918 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef0b5b-ba0a-4df3-8581-0e4e3d26824f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:00.652458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef0b5b-ba0a-4df3-8581-0e4e3d26824f service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:00.661402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1380/2775] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:01.982422 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454545c-4176-463e-bb57-50f6262b302c service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:01.990930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454545c-4176-463e-bb57-50f6262b302c service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:01.995269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536773b-4d7c-4e82-ba1f-25b7c5c22bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:01.995879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536773b-4d7c-4e82-ba1f-25b7c5c22bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:01.996154 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536773b-4d7c-4e82-ba1f-25b7c5c22bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:01.996419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536773b-4d7c-4e82-ba1f-25b7c5c22bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:02.005265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536773b-4d7c-4e82-ba1f-25b7c5c22bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:02.006710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536773b-4d7c-4e82-ba1f-25b7c5c22bd6 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:02.016739 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1396/2776] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:06.936227 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef0b5b-ba0a-4df3-8581-0e4e3d26824f service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.007332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef0b5b-ba0a-4df3-8581-0e4e3d26824f service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.012654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.013285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.013558 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.013826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] PATH_INFO: `/v3/users/2ea0faaa52d147068cd6af8662d7feab` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.014956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea0faaa52d147068cd6af8662d7feab)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.016897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.039828 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:07.199767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea0faaa52d147068cd6af8662d7feab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.206695 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea0faaa52d147068cd6af8662d7feab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.218355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea0faaa52d147068cd6af8662d7feab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.219026 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea0faaa52d147068cd6af8662d7feab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.219626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea0faaa52d147068cd6af8662d7feab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:07.304955 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1381/2777] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:06 2022] DELETE /identity/v3/users/2ea0faaa52d147068cd6af8662d7feab => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:07.310115 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06d9b-ba1a-4d39-ae84-98aab30c658d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.310608 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06d9b-ba1a-4d39-ae84-98aab30c658d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.311789 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06d9b-ba1a-4d39-ae84-98aab30c658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.329871 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d2f06d9b-ba1a-4d39-ae84-98aab30c658d None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:07.331066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d2f06d9b-ba1a-4d39-ae84-98aab30c658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:07.388136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1397/2778] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:07.397690 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.399070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:07.457197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644803ad-2da9-4d0f-a737-6f8d331f20ef admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.460925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb2cee-276e-4943-b65f-6ef13baf767c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.461527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb2cee-276e-4943-b65f-6ef13baf767c service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.461803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb2cee-276e-4943-b65f-6ef13baf767c service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.462072 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb2cee-276e-4943-b65f-6ef13baf767c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.471007 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb2cee-276e-4943-b65f-6ef13baf767c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.472466 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb2cee-276e-4943-b65f-6ef13baf767c service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:07.482502 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1382/2779] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:07.929305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f06d9b-ba1a-4d39-ae84-98aab30c658d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:07.930735 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d2f06d9b-ba1a-4d39-ae84-98aab30c658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:07.943009 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f06d9b-ba1a-4d39-ae84-98aab30c658d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:07.947838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:07.948479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:07.948756 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:07.949073 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] PATH_INFO: `/v3/projects/75e4353827b14df39428e7a229fd1567` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:07.950278 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e4353827b14df39428e7a229fd1567)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:07.952220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.083183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e4353827b14df39428e7a229fd1567', 'request_id': 'req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.090503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e4353827b14df39428e7a229fd1567', 'request_id': 'req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.096361 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e4353827b14df39428e7a229fd1567', 'request_id': 'req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.144031 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] The token cache is being invalidate because project 75e4353827b14df39428e7a229fd1567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:08.144323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.144939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.146425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1398/2780] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:07 2022] DELETE /identity/v3/projects/75e4353827b14df39428e7a229fd1567 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:08.150621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb2cee-276e-4943-b65f-6ef13baf767c service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:08.161220 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb2cee-276e-4943-b65f-6ef13baf767c service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:08.222121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:08.222696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:08.222980 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:08.223255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] PATH_INFO: `/v3/users/b57cde6570234664bad3f4a810dcacc2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:08.224396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57cde6570234664bad3f4a810dcacc2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:08.226307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:08.379804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:08.382426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57cde6570234664bad3f4a810dcacc2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.389810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57cde6570234664bad3f4a810dcacc2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.401800 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57cde6570234664bad3f4a810dcacc2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.403303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57cde6570234664bad3f4a810dcacc2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.403303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57cde6570234664bad3f4a810dcacc2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:08.505249 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1383/2781] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:08 2022] DELETE /identity/v3/users/b57cde6570234664bad3f4a810dcacc2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:08.963576 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:08.966087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:08.981820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03f3f5-0174-43aa-bd88-de6ce4047f7c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:09.001911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:09.040453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:09.040991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:09.041269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:09.041542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] PATH_INFO: `/v3/projects/81fa932c3203475f932427c6e03e6b6a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:09.043486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fa932c3203475f932427c6e03e6b6a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:09.045400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:09.139059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fa932c3203475f932427c6e03e6b6a', 'request_id': 'req-d3cdc630-8d3b-40b0-b395-c63450559cd3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.145265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fa932c3203475f932427c6e03e6b6a', 'request_id': 'req-d3cdc630-8d3b-40b0-b395-c63450559cd3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.150772 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fa932c3203475f932427c6e03e6b6a', 'request_id': 'req-d3cdc630-8d3b-40b0-b395-c63450559cd3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.213175 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] The token cache is being invalidate because project 81fa932c3203475f932427c6e03e6b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:09.213469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.214661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.216165 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1399/2782] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:08 2022] DELETE /identity/v3/projects/81fa932c3203475f932427c6e03e6b6a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:09.220102 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:09.221494 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:09.234750 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ce35f-02e8-4a30-8bce-cc58ea3cf692 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:09.298185 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:09.298824 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:09.299104 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:09.299381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] PATH_INFO: `/v3/users/63499eaf11814c48a0a58f0bc9a8b338` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:09.300660 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=63499eaf11814c48a0a58f0bc9a8b338)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:09.302614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:09.494956 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63499eaf11814c48a0a58f0bc9a8b338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.502676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63499eaf11814c48a0a58f0bc9a8b338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.515770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63499eaf11814c48a0a58f0bc9a8b338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.516475 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63499eaf11814c48a0a58f0bc9a8b338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.517077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0db1dbf6-1186-4d88-96bb-1f2cb5c4a09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63499eaf11814c48a0a58f0bc9a8b338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:09.567458 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1384/2783] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:09 2022] DELETE /identity/v3/users/63499eaf11814c48a0a58f0bc9a8b338 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:09.940978 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:09.942400 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:09.955731 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdc630-8d3b-40b0-b395-c63450559cd3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.012900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.013577 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.013783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.014050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] PATH_INFO: `/v3/projects/49b92182a7484ec2b844363551da8f59` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.015176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b92182a7484ec2b844363551da8f59)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.017163 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.128646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b92182a7484ec2b844363551da8f59', 'request_id': 'req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.134677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b92182a7484ec2b844363551da8f59', 'request_id': 'req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.136488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:10.141376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b92182a7484ec2b844363551da8f59', 'request_id': 'req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.195264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] The token cache is being invalidate because project 49b92182a7484ec2b844363551da8f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:10.195699 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.196566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3ef888bb-0ddf-4f80-ac33-e45d7818ae65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:10.199344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1400/2784] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:09 2022] DELETE /identity/v3/projects/49b92182a7484ec2b844363551da8f59 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:10.203856 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff5b4c-b89c-4db6-ac3f-1e2721a4eb76 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.206240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff5b4c-b89c-4db6-ac3f-1e2721a4eb76 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.206240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff5b4c-b89c-4db6-ac3f-1e2721a4eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.223972 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e2ff5b4c-b89c-4db6-ac3f-1e2721a4eb76 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:10.225164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e2ff5b4c-b89c-4db6-ac3f-1e2721a4eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:10.259074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:10.284533 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1385/2785] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:10.293234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf6ac-78df-4af9-a3d0-724cb8d52e7f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.293509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf6ac-78df-4af9-a3d0-724cb8d52e7f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.293778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf6ac-78df-4af9-a3d0-724cb8d52e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.314407 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-48bbf6ac-78df-4af9-a3d0-724cb8d52e7f None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:10.315922 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-48bbf6ac-78df-4af9-a3d0-724cb8d52e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:10.324070 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1401/2786] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:10.328397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff5b4c-b89c-4db6-ac3f-1e2721a4eb76 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.338642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff5b4c-b89c-4db6-ac3f-1e2721a4eb76 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.343266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829996a-8a61-4e47-b855-69a5b25a4c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.343944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829996a-8a61-4e47-b855-69a5b25a4c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.344223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829996a-8a61-4e47-b855-69a5b25a4c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.344495 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829996a-8a61-4e47-b855-69a5b25a4c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.345136 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829996a-8a61-4e47-b855-69a5b25a4c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:36:10.345436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829996a-8a61-4e47-b855-69a5b25a4c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.347013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829996a-8a61-4e47-b855-69a5b25a4c7c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.359106 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1386/2787] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:36:10.363683 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf6ac-78df-4af9-a3d0-724cb8d52e7f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.373609 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf6ac-78df-4af9-a3d0-724cb8d52e7f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.378197 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f08fa5-d0a4-429b-9ccc-7abfed274609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.378841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f08fa5-d0a4-429b-9ccc-7abfed274609 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.379062 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f08fa5-d0a4-429b-9ccc-7abfed274609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.379335 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f08fa5-d0a4-429b-9ccc-7abfed274609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.380000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f08fa5-d0a4-429b-9ccc-7abfed274609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.381892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f08fa5-d0a4-429b-9ccc-7abfed274609 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.489224 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1402/2788] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:10.493599 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829996a-8a61-4e47-b855-69a5b25a4c7c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.504211 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829996a-8a61-4e47-b855-69a5b25a4c7c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.560578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b220-93de-4da0-8af5-eeee92b8a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.561174 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b220-93de-4da0-8af5-eeee92b8a65f admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.561444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b220-93de-4da0-8af5-eeee92b8a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.561740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b220-93de-4da0-8af5-eeee92b8a65f admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.562360 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b220-93de-4da0-8af5-eeee92b8a65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.564300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b220-93de-4da0-8af5-eeee92b8a65f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.656010 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1387/2789] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:36:10.660111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f08fa5-d0a4-429b-9ccc-7abfed274609 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.671211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f08fa5-d0a4-429b-9ccc-7abfed274609 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.675780 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed6529-4209-4da9-b80b-d33956847c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.676371 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed6529-4209-4da9-b80b-d33956847c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.676646 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed6529-4209-4da9-b80b-d33956847c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.676915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed6529-4209-4da9-b80b-d33956847c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.677555 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed6529-4209-4da9-b80b-d33956847c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.679135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed6529-4209-4da9-b80b-d33956847c48 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.689155 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1403/2790] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:10.695704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b220-93de-4da0-8af5-eeee92b8a65f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.706257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b220-93de-4da0-8af5-eeee92b8a65f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.710810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090be96-6e56-42d3-ac0c-1565aeac45dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.711399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090be96-6e56-42d3-ac0c-1565aeac45dd admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.711676 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090be96-6e56-42d3-ac0c-1565aeac45dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.711979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090be96-6e56-42d3-ac0c-1565aeac45dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.712646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090be96-6e56-42d3-ac0c-1565aeac45dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.714727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090be96-6e56-42d3-ac0c-1565aeac45dd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.725507 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1388/2791] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:36:10.730462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed6529-4209-4da9-b80b-d33956847c48 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.740542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed6529-4209-4da9-b80b-d33956847c48 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:10.745415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1f13-7dc6-4105-b3c9-fe8edc591784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:10.746068 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1f13-7dc6-4105-b3c9-fe8edc591784 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.746343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1f13-7dc6-4105-b3c9-fe8edc591784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.746614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1f13-7dc6-4105-b3c9-fe8edc591784 admin admin] PATH_INFO: `/v3/projects/a67ecc433cc3421db8757a5c583527ce/users/b7720202d7d94f1bbff9dd8774243737/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.762514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f1f13-7dc6-4105-b3c9-fe8edc591784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67ecc433cc3421db8757a5c583527ce, user_id=b7720202d7d94f1bbff9dd8774243737, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:10.765458 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f1f13-7dc6-4105-b3c9-fe8edc591784 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:10.848092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1404/2792] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:36:10 2022] PUT /identity/v3/projects/a67ecc433cc3421db8757a5c583527ce/users/b7720202d7d94f1bbff9dd8774243737/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:10.860164 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf69791-6419-42c5-8a61-6b827f91d7c7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:10.860450 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf69791-6419-42c5-8a61-6b827f91d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:10.860724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf69791-6419-42c5-8a61-6b827f91d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:10.888484 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-bbf69791-6419-42c5-8a61-6b827f91d7c7 None None] MFA Rules not processed for user `b7720202d7d94f1bbff9dd8774243737`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:10.889744 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bbf69791-6419-42c5-8a61-6b827f91d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:10.955014 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1389/2793] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:36:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:10.966452 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1f13-7dc6-4105-b3c9-fe8edc591784 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:10.968157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f25f1f13-7dc6-4105-b3c9-fe8edc591784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:11.025076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1f13-7dc6-4105-b3c9-fe8edc591784 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:11.029267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb8546-2e2d-4c88-9390-1751c3c5be9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:11.029864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8546-2e2d-4c88-9390-1751c3c5be9a service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:11.030148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8546-2e2d-4c88-9390-1751c3c5be9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:11.030419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8546-2e2d-4c88-9390-1751c3c5be9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:11.039169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb8546-2e2d-4c88-9390-1751c3c5be9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:11.040629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb8546-2e2d-4c88-9390-1751c3c5be9a service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:11.049508 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1405/2794] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:20.951869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:21.045529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=3,keystone:SELECT=57,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:22.121070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf69791-6419-42c5-8a61-6b827f91d7c7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:22.182612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf69791-6419-42c5-8a61-6b827f91d7c7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:22.187327 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:22.187983 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:22.188264 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:22.188536 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] PATH_INFO: `/v3/users/b7720202d7d94f1bbff9dd8774243737` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:22.189642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7720202d7d94f1bbff9dd8774243737)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:22.191832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:22.489045 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7720202d7d94f1bbff9dd8774243737'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:22.495723 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7720202d7d94f1bbff9dd8774243737'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:22.507429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7720202d7d94f1bbff9dd8774243737'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:22.508125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7720202d7d94f1bbff9dd8774243737'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:22.508740 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7720202d7d94f1bbff9dd8774243737'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:22.617945 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1390/2795] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:36:22 2022] DELETE /identity/v3/users/b7720202d7d94f1bbff9dd8774243737 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:22.623091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863da87-9ad6-46a1-99a9-ddd158682c26 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:22.623583 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863da87-9ad6-46a1-99a9-ddd158682c26 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:22.623690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863da87-9ad6-46a1-99a9-ddd158682c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:22.643231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6863da87-9ad6-46a1-99a9-ddd158682c26 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:36:22.644535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6863da87-9ad6-46a1-99a9-ddd158682c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:22.702030 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1406/2796] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:36:22.711869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:22.713265 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:22.772152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46dadc-6303-4d10-a613-d015a12efefa admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:22.775846 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3bfd5-d815-4538-a356-02e509b5b9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:22.776448 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3bfd5-d815-4538-a356-02e509b5b9ba service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:22.776722 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3bfd5-d815-4538-a356-02e509b5b9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:22.776996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3bfd5-d815-4538-a356-02e509b5b9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:22.786612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3bfd5-d815-4538-a356-02e509b5b9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:22.788078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3bfd5-d815-4538-a356-02e509b5b9ba service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:22.798123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1391/2797] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:23.180625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863da87-9ad6-46a1-99a9-ddd158682c26 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:23.182212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6863da87-9ad6-46a1-99a9-ddd158682c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:23.195482 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863da87-9ad6-46a1-99a9-ddd158682c26 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:23.200712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:23.201418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:23.202649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:23.202649 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] PATH_INFO: `/v3/projects/a67ecc433cc3421db8757a5c583527ce` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:23.203372 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67ecc433cc3421db8757a5c583527ce)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:23.205324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:23.294517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67ecc433cc3421db8757a5c583527ce', 'request_id': 'req-755bbfb3-0782-4102-bf19-8efb474e25b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:23.300729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67ecc433cc3421db8757a5c583527ce', 'request_id': 'req-755bbfb3-0782-4102-bf19-8efb474e25b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:23.306116 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67ecc433cc3421db8757a5c583527ce', 'request_id': 'req-755bbfb3-0782-4102-bf19-8efb474e25b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:23.366941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] The token cache is being invalidate because project a67ecc433cc3421db8757a5c583527ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:36:23.367222 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:23.367861 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:36:23.369324 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1407/2798] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:36:23 2022] DELETE /identity/v3/projects/a67ecc433cc3421db8757a5c583527ce => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:36:32.793248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:33.363712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:55.636944 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3bfd5-d815-4538-a356-02e509b5b9ba service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:36:55.639155 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-68c3bfd5-d815-4538-a356-02e509b5b9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:55.650754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3bfd5-d815-4538-a356-02e509b5b9ba service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:36:55.699925 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:36:55.700518 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:36:55.700791 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:36:55.701060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:36:55.702768 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:36:55.711942 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:36:55.713346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:36:55.722097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1392/2799] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:36:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:05.719138 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=26 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:06.175819 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:06.177264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:06.238214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bbfb3-0782-4102-bf19-8efb474e25b6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:06.242325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:06.243120 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:06.243341 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:06.243619 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:06.245519 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:06.319264 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:06.320703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:06.331975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1408/2800] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:37:09.416804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:09.418290 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:09.430059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a375ec-39a5-4ab7-a0f3-0ab7dcf7e1ab service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:09.433641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:09.434783 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:09.435074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:09.435346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:09.437153 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:09.451347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:09.453075 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:09.464006 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1393/2801] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:37:15.206988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:15.208562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:15.222526 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad68be-186f-4ca0-a8ef-53af3a8a7997 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:15.228090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:15.228691 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:15.228962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:15.229231 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:15.230925 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:15.243847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:15.245568 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:15.260131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1409/2802] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:19.459108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:22.048172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:22.049615 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:22.060992 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e94fc-a49b-4ee5-a436-18e4d618be93 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:22.065278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68332-342a-4cbd-a192-dbc5ddd1a0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:22.066125 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68332-342a-4cbd-a192-dbc5ddd1a0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:22.066404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68332-342a-4cbd-a192-dbc5ddd1a0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:22.066677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68332-342a-4cbd-a192-dbc5ddd1a0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:22.068358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fcc68332-342a-4cbd-a192-dbc5ddd1a0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:22.130917 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc68332-342a-4cbd-a192-dbc5ddd1a0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:22.132374 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc68332-342a-4cbd-a192-dbc5ddd1a0d0 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:22.141826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1394/2803] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:25.253295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=60 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:25.613625 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:25.615092 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:25.629648 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c7ffa-6e81-409d-aaa0-70b540d395d1 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:25.634283 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:25.634909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:25.635183 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:25.635455 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] PATH_INFO: `/v3/users/ee53d2aaeaaf4ad796814293638123ba` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:25.636599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee53d2aaeaaf4ad796814293638123ba)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:25.638505 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:25.802778 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee53d2aaeaaf4ad796814293638123ba'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:25.803425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee53d2aaeaaf4ad796814293638123ba'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:25.880566 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee53d2aaeaaf4ad796814293638123ba'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:25.881173 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee53d2aaeaaf4ad796814293638123ba'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:25.894089 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3410d665-e38f-4780-97b5-9f740e3b3b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee53d2aaeaaf4ad796814293638123ba'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:25.906089 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1410/2804] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:25 2022] DELETE /identity/v3/users/ee53d2aaeaaf4ad796814293638123ba => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:26.145424 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68332-342a-4cbd-a192-dbc5ddd1a0d0 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:26.157632 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68332-342a-4cbd-a192-dbc5ddd1a0d0 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:26.216572 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:26.217197 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.217473 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.217743 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] PATH_INFO: `/v3/projects/c62636149d5344afb63325a435f25c34` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.218836 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62636149d5344afb63325a435f25c34)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:26.221391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:26.309797 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62636149d5344afb63325a435f25c34', 'request_id': 'req-e03b5de0-9ccf-4507-91f4-8e68078c229a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:26.316393 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62636149d5344afb63325a435f25c34', 'request_id': 'req-e03b5de0-9ccf-4507-91f4-8e68078c229a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:26.371775 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62636149d5344afb63325a435f25c34', 'request_id': 'req-e03b5de0-9ccf-4507-91f4-8e68078c229a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:26.382622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] The token cache is being invalidate because project c62636149d5344afb63325a435f25c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:26.382907 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:26.383523 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-e03b5de0-9ccf-4507-91f4-8e68078c229a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:26.385029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1395/2805] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:26 2022] DELETE /identity/v3/projects/c62636149d5344afb63325a435f25c34 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:26.390052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b4a9b-1f02-4d90-beb0-8defdbc69d13 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.390535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b4a9b-1f02-4d90-beb0-8defdbc69d13 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.390535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b4a9b-1f02-4d90-beb0-8defdbc69d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.411123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2d5b4a9b-1f02-4d90-beb0-8defdbc69d13 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:26.412351 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2d5b4a9b-1f02-4d90-beb0-8defdbc69d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:26.471541 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1411/2806] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:26.479819 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1443863-bc49-400c-b3a7-5c55e0eb1e68 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.480111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1443863-bc49-400c-b3a7-5c55e0eb1e68 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.480367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1443863-bc49-400c-b3a7-5c55e0eb1e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.501901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b1443863-bc49-400c-b3a7-5c55e0eb1e68 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:26.503835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b1443863-bc49-400c-b3a7-5c55e0eb1e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:26.512009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1396/2807] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:26.516384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b4a9b-1f02-4d90-beb0-8defdbc69d13 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:26.531488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b4a9b-1f02-4d90-beb0-8defdbc69d13 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:26.533297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd18cf-7e45-4a93-83e8-26d91f956834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:26.533941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd18cf-7e45-4a93-83e8-26d91f956834 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.534275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd18cf-7e45-4a93-83e8-26d91f956834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.534547 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd18cf-7e45-4a93-83e8-26d91f956834 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.535204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd18cf-7e45-4a93-83e8-26d91f956834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:37:26.535597 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd18cf-7e45-4a93-83e8-26d91f956834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:26.537333 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd18cf-7e45-4a93-83e8-26d91f956834 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:26.550145 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1412/2808] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:37:26.554499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1443863-bc49-400c-b3a7-5c55e0eb1e68 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:26.564646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1443863-bc49-400c-b3a7-5c55e0eb1e68 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:26.571685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaff588-6821-4868-a32d-42b8d0dc15db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:26.571685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaff588-6821-4868-a32d-42b8d0dc15db admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.571685 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaff588-6821-4868-a32d-42b8d0dc15db admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.572437 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaff588-6821-4868-a32d-42b8d0dc15db admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.572716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaff588-6821-4868-a32d-42b8d0dc15db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:26.574417 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaff588-6821-4868-a32d-42b8d0dc15db admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:26.590724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:26.704490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1397/2809] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:26 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:26.708734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd18cf-7e45-4a93-83e8-26d91f956834 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:26.718736 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd18cf-7e45-4a93-83e8-26d91f956834 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:26.774562 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730ff5c-2a47-4e17-9589-c35ebf7b35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:26.775164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730ff5c-2a47-4e17-9589-c35ebf7b35c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.775444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730ff5c-2a47-4e17-9589-c35ebf7b35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.775716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730ff5c-2a47-4e17-9589-c35ebf7b35c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.776411 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730ff5c-2a47-4e17-9589-c35ebf7b35c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:26.778325 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730ff5c-2a47-4e17-9589-c35ebf7b35c8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:26.786293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:26.881178 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1413/2810] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:26 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:26.885365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaff588-6821-4868-a32d-42b8d0dc15db admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:26.895978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaff588-6821-4868-a32d-42b8d0dc15db admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:26.900738 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4f5d-e396-463e-b8bc-e9df16902a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:26.901332 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4f5d-e396-463e-b8bc-e9df16902a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.901609 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4f5d-e396-463e-b8bc-e9df16902a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.901879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4f5d-e396-463e-b8bc-e9df16902a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.902519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4f5d-e396-463e-b8bc-e9df16902a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:26.904145 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4f5d-e396-463e-b8bc-e9df16902a1f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:26.914831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1398/2811] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:26.918593 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730ff5c-2a47-4e17-9589-c35ebf7b35c8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:26.929394 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730ff5c-2a47-4e17-9589-c35ebf7b35c8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:26.933983 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c25ba8-13c8-45fc-aa21-768465fef813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:26.934567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c25ba8-13c8-45fc-aa21-768465fef813 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.934841 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c25ba8-13c8-45fc-aa21-768465fef813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.935139 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c25ba8-13c8-45fc-aa21-768465fef813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.935793 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c25ba8-13c8-45fc-aa21-768465fef813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:26.937369 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c25ba8-13c8-45fc-aa21-768465fef813 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:26.948093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1414/2812] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:26.952143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4f5d-e396-463e-b8bc-e9df16902a1f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:26.962341 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4f5d-e396-463e-b8bc-e9df16902a1f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:26.966928 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdbc58-104b-4497-8b00-c2956ad5879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:26.967564 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdbc58-104b-4497-8b00-c2956ad5879b admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:26.967883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdbc58-104b-4497-8b00-c2956ad5879b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:26.968160 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdbc58-104b-4497-8b00-c2956ad5879b admin admin] PATH_INFO: `/v3/projects/49d1d43f51e7437383fab9258f872307/users/6efd9d4900c742e48ce8127ab784353f/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:26.983575 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdbc58-104b-4497-8b00-c2956ad5879b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d1d43f51e7437383fab9258f872307, user_id=6efd9d4900c742e48ce8127ab784353f, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:26.987046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdbc58-104b-4497-8b00-c2956ad5879b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:27.098127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1399/2813] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:26 2022] PUT /identity/v3/projects/49d1d43f51e7437383fab9258f872307/users/6efd9d4900c742e48ce8127ab784353f/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:27.108488 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0aa6-4c5f-4e6e-896d-030f1a88c9ba None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:27.108771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0aa6-4c5f-4e6e-896d-030f1a88c9ba None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:27.109047 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0aa6-4c5f-4e6e-896d-030f1a88c9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:27.137086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b7bb0aa6-4c5f-4e6e-896d-030f1a88c9ba None None] MFA Rules not processed for user `6efd9d4900c742e48ce8127ab784353f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:27.138250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b7bb0aa6-4c5f-4e6e-896d-030f1a88c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:27.202220 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1415/2814] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:27.214441 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdbc58-104b-4497-8b00-c2956ad5879b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:27.216195 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5cfdbc58-104b-4497-8b00-c2956ad5879b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:27.290869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdbc58-104b-4497-8b00-c2956ad5879b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:27.296725 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d3905-fc34-402c-bea3-3747af981c75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:27.297334 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3905-fc34-402c-bea3-3747af981c75 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:27.298148 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3905-fc34-402c-bea3-3747af981c75 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:27.298421 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3905-fc34-402c-bea3-3747af981c75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:27.306217 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d3905-fc34-402c-bea3-3747af981c75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:27.307883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d3905-fc34-402c-bea3-3747af981c75 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:27.318430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1400/2815] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:27.543706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb0aa6-4c5f-4e6e-896d-030f1a88c9ba None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:27.605960 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb0aa6-4c5f-4e6e-896d-030f1a88c9ba None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:27.611085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:27.611904 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:27.612024 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:27.612262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] PATH_INFO: `/v3/users/6efd9d4900c742e48ce8127ab784353f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:27.613995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efd9d4900c742e48ce8127ab784353f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:27.615945 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:27.814206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efd9d4900c742e48ce8127ab784353f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:27.814958 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efd9d4900c742e48ce8127ab784353f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:27.903320 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efd9d4900c742e48ce8127ab784353f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:27.904059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efd9d4900c742e48ce8127ab784353f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:27.915790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:27.917140 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efd9d4900c742e48ce8127ab784353f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:27.929302 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1416/2816] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:27 2022] DELETE /identity/v3/users/6efd9d4900c742e48ce8127ab784353f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:27.933790 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d059-67a5-42cb-adac-32ca7472ccd0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:27.934080 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d059-67a5-42cb-adac-32ca7472ccd0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:27.934375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d059-67a5-42cb-adac-32ca7472ccd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:27.954516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0ae0d059-67a5-42cb-adac-32ca7472ccd0 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:27.960701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0ae0d059-67a5-42cb-adac-32ca7472ccd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:28.014345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1401/2817] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:28.024758 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:28.026184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:28.084799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658ec0e-5778-4833-902f-7fe968899350 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:28.088377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc49f00-3a2e-407c-adcf-2693924e7de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:28.088976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc49f00-3a2e-407c-adcf-2693924e7de1 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:28.089254 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc49f00-3a2e-407c-adcf-2693924e7de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:28.089525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc49f00-3a2e-407c-adcf-2693924e7de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:28.099149 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc49f00-3a2e-407c-adcf-2693924e7de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:28.100605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc49f00-3a2e-407c-adcf-2693924e7de1 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:28.109860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1417/2818] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:28.550908 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d059-67a5-42cb-adac-32ca7472ccd0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:28.553275 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0ae0d059-67a5-42cb-adac-32ca7472ccd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:28.571357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d059-67a5-42cb-adac-32ca7472ccd0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:28.576996 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:28.577716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:28.577889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:28.578157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] PATH_INFO: `/v3/projects/49d1d43f51e7437383fab9258f872307` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:28.579943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d1d43f51e7437383fab9258f872307)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:28.581938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:28.692405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:28.698528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d1d43f51e7437383fab9258f872307', 'request_id': 'req-498da145-031e-4f5d-851f-b63d2e78bcb9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.704967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d1d43f51e7437383fab9258f872307', 'request_id': 'req-498da145-031e-4f5d-851f-b63d2e78bcb9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.788664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d1d43f51e7437383fab9258f872307', 'request_id': 'req-498da145-031e-4f5d-851f-b63d2e78bcb9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.800205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] The token cache is being invalidate because project 49d1d43f51e7437383fab9258f872307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:28.800693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.801911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-498da145-031e-4f5d-851f-b63d2e78bcb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:28.803519 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1402/2819] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:28 2022] DELETE /identity/v3/projects/49d1d43f51e7437383fab9258f872307 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:28.808464 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea785b-038c-4251-84ae-5631b9dcd299 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:28.808947 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea785b-038c-4251-84ae-5631b9dcd299 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:28.809084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea785b-038c-4251-84ae-5631b9dcd299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:28.830066 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-08ea785b-038c-4251-84ae-5631b9dcd299 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:28.831289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-08ea785b-038c-4251-84ae-5631b9dcd299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:28.889757 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1418/2820] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:28.898412 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd88cf-e5a9-4abd-a70e-3577b8f209f4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:28.898692 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd88cf-e5a9-4abd-a70e-3577b8f209f4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:28.899046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd88cf-e5a9-4abd-a70e-3577b8f209f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:28.920577 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c0bd88cf-e5a9-4abd-a70e-3577b8f209f4 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:28.923180 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c0bd88cf-e5a9-4abd-a70e-3577b8f209f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:28.929978 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1403/2821] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:37:28.934364 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea785b-038c-4251-84ae-5631b9dcd299 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:28.944783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea785b-038c-4251-84ae-5631b9dcd299 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:28.949269 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb8c65-e43c-40ae-a835-ed5be17f9442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:28.949856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb8c65-e43c-40ae-a835-ed5be17f9442 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:28.950135 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb8c65-e43c-40ae-a835-ed5be17f9442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:28.953087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb8c65-e43c-40ae-a835-ed5be17f9442 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:28.953087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb8c65-e43c-40ae-a835-ed5be17f9442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:37:28.953087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb8c65-e43c-40ae-a835-ed5be17f9442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:28.953087 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb8c65-e43c-40ae-a835-ed5be17f9442 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:28.965078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1419/2822] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:37:28.970298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd88cf-e5a9-4abd-a70e-3577b8f209f4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:28.979814 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd88cf-e5a9-4abd-a70e-3577b8f209f4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:28.984741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f53fb-4cb9-4c66-9199-06f82cd072f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:28.987635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f53fb-4cb9-4c66-9199-06f82cd072f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:28.987635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f53fb-4cb9-4c66-9199-06f82cd072f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:28.987635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f53fb-4cb9-4c66-9199-06f82cd072f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:28.987635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f53fb-4cb9-4c66-9199-06f82cd072f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:28.988491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f53fb-4cb9-4c66-9199-06f82cd072f5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:29.100088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1404/2823] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:28 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:37:29.104448 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb8c65-e43c-40ae-a835-ed5be17f9442 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:29.114415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb8c65-e43c-40ae-a835-ed5be17f9442 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:29.174595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace50b71-8e13-4406-ad4c-78167ef1a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:29.175193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace50b71-8e13-4406-ad4c-78167ef1a9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:29.175466 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace50b71-8e13-4406-ad4c-78167ef1a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:29.175733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace50b71-8e13-4406-ad4c-78167ef1a9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:29.176384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace50b71-8e13-4406-ad4c-78167ef1a9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:29.178277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace50b71-8e13-4406-ad4c-78167ef1a9d6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:29.304063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1420/2824] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:29 2022] POST /identity/v3/users => generated 282 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:29.308295 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f53fb-4cb9-4c66-9199-06f82cd072f5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:29.319248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f53fb-4cb9-4c66-9199-06f82cd072f5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:29.323799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc6f6a-299b-4eeb-8105-58568a84f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:29.324388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc6f6a-299b-4eeb-8105-58568a84f0da admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:29.324663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc6f6a-299b-4eeb-8105-58568a84f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:29.324931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc6f6a-299b-4eeb-8105-58568a84f0da admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:29.325566 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc6f6a-299b-4eeb-8105-58568a84f0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:29.327143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc6f6a-299b-4eeb-8105-58568a84f0da admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:29.337547 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1405/2825] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:29.341545 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace50b71-8e13-4406-ad4c-78167ef1a9d6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:29.351421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace50b71-8e13-4406-ad4c-78167ef1a9d6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:29.356010 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9fb6b-4bdd-475e-a735-4dc7c93ea6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:29.356591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9fb6b-4bdd-475e-a735-4dc7c93ea6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:29.360052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9fb6b-4bdd-475e-a735-4dc7c93ea6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:29.360052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9fb6b-4bdd-475e-a735-4dc7c93ea6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:29.360052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9fb6b-4bdd-475e-a735-4dc7c93ea6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:29.360052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9fb6b-4bdd-475e-a735-4dc7c93ea6c8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:29.360790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:29.370086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1421/2826] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:29.374292 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc6f6a-299b-4eeb-8105-58568a84f0da admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:29.384813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc6f6a-299b-4eeb-8105-58568a84f0da admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:29.389451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b63d-d0f2-491f-abdf-f39db2f71729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:29.390115 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b63d-d0f2-491f-abdf-f39db2f71729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:29.391964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b63d-d0f2-491f-abdf-f39db2f71729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:29.391964 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b63d-d0f2-491f-abdf-f39db2f71729 admin admin] PATH_INFO: `/v3/projects/be89d1d8c092412c8ec1e3bcca8e1cd9/users/d87890184cb44b6d812688acd43d1ecd/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:29.406135 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356b63d-d0f2-491f-abdf-f39db2f71729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be89d1d8c092412c8ec1e3bcca8e1cd9, user_id=d87890184cb44b6d812688acd43d1ecd, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:29.409042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356b63d-d0f2-491f-abdf-f39db2f71729 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:29.512711 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1406/2827] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:29 2022] PUT /identity/v3/projects/be89d1d8c092412c8ec1e3bcca8e1cd9/users/d87890184cb44b6d812688acd43d1ecd/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:29.526542 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b0f8c-3b72-4a0f-bcb2-778be92f8c0c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:29.526826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b0f8c-3b72-4a0f-bcb2-778be92f8c0c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:29.527098 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b0f8c-3b72-4a0f-bcb2-778be92f8c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:29.555766 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4b2b0f8c-3b72-4a0f-bcb2-778be92f8c0c None None] MFA Rules not processed for user `d87890184cb44b6d812688acd43d1ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:29.556971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4b2b0f8c-3b72-4a0f-bcb2-778be92f8c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:29.619684 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1422/2828] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:29.624146 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b63d-d0f2-491f-abdf-f39db2f71729 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:29.685282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b63d-d0f2-491f-abdf-f39db2f71729 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:29.690902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b50f2-b707-4d1a-b2c4-5b98879fbef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:29.691679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b50f2-b707-4d1a-b2c4-5b98879fbef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:29.691823 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b50f2-b707-4d1a-b2c4-5b98879fbef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:29.692065 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b50f2-b707-4d1a-b2c4-5b98879fbef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:29.692698 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b50f2-b707-4d1a-b2c4-5b98879fbef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:29.694604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b50f2-b707-4d1a-b2c4-5b98879fbef5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:29.796858 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1407/2829] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:29 2022] POST /identity/v3/projects => generated 363 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:37:29.801751 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b0f8c-3b72-4a0f-bcb2-778be92f8c0c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:29.812450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b0f8c-3b72-4a0f-bcb2-778be92f8c0c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:29.868533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8cefc-6e4e-4a71-ab6e-06614ef98e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:29.869131 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8cefc-6e4e-4a71-ab6e-06614ef98e29 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:29.869415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8cefc-6e4e-4a71-ab6e-06614ef98e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:29.869706 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8cefc-6e4e-4a71-ab6e-06614ef98e29 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:29.870321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8cefc-6e4e-4a71-ab6e-06614ef98e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:29.872265 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8cefc-6e4e-4a71-ab6e-06614ef98e29 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:29.972210 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1423/2830] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:29 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:29.976182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b50f2-b707-4d1a-b2c4-5b98879fbef5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:29.987053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b50f2-b707-4d1a-b2c4-5b98879fbef5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:29.991662 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5748f-3bb2-45c9-826c-b24a2cd7a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:29.992283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5748f-3bb2-45c9-826c-b24a2cd7a214 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:29.992561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5748f-3bb2-45c9-826c-b24a2cd7a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:29.992835 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5748f-3bb2-45c9-826c-b24a2cd7a214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:29.993471 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5748f-3bb2-45c9-826c-b24a2cd7a214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:29.995060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5748f-3bb2-45c9-826c-b24a2cd7a214 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:30.005757 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1408/2831] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:30.009903 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8cefc-6e4e-4a71-ab6e-06614ef98e29 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:30.019900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8cefc-6e4e-4a71-ab6e-06614ef98e29 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:30.024399 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cdf7d-6e06-40fd-aede-7d188b8a0879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:30.025033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cdf7d-6e06-40fd-aede-7d188b8a0879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:30.025307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cdf7d-6e06-40fd-aede-7d188b8a0879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:30.025578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cdf7d-6e06-40fd-aede-7d188b8a0879 admin admin] PATH_INFO: `/v3/projects/ee08ef7c07e54ea3b003a8f71d2f0580/users/ded2828c845c4b40bccf484871f8c603/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:30.040463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cdf7d-6e06-40fd-aede-7d188b8a0879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee08ef7c07e54ea3b003a8f71d2f0580, user_id=ded2828c845c4b40bccf484871f8c603, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:30.043090 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cdf7d-6e06-40fd-aede-7d188b8a0879 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:30.097827 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1424/2832] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:30 2022] PUT /identity/v3/projects/ee08ef7c07e54ea3b003a8f71d2f0580/users/ded2828c845c4b40bccf484871f8c603/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:30.101847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5748f-3bb2-45c9-826c-b24a2cd7a214 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:30.112653 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5748f-3bb2-45c9-826c-b24a2cd7a214 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:30.152606 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:30.170512 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0ad3b-084d-4dc7-bf7f-b0a8e37e084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:30.171121 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0ad3b-084d-4dc7-bf7f-b0a8e37e084a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:30.171400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0ad3b-084d-4dc7-bf7f-b0a8e37e084a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:30.171669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0ad3b-084d-4dc7-bf7f-b0a8e37e084a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:30.172365 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0ad3b-084d-4dc7-bf7f-b0a8e37e084a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:30.174013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0ad3b-084d-4dc7-bf7f-b0a8e37e084a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:30.184425 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1409/2833] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:30.188618 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cdf7d-6e06-40fd-aede-7d188b8a0879 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:30.199696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cdf7d-6e06-40fd-aede-7d188b8a0879 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:30.204305 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb42eda-e87d-4e60-9f9b-fdce327352e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:30.205666 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42eda-e87d-4e60-9f9b-fdce327352e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:30.205975 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42eda-e87d-4e60-9f9b-fdce327352e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:30.206267 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb42eda-e87d-4e60-9f9b-fdce327352e5 admin admin] PATH_INFO: `/v3/projects/ee08ef7c07e54ea3b003a8f71d2f0580/users/ded2828c845c4b40bccf484871f8c603/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:30.208311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb42eda-e87d-4e60-9f9b-fdce327352e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee08ef7c07e54ea3b003a8f71d2f0580, user_id=ded2828c845c4b40bccf484871f8c603, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:30.210995 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb42eda-e87d-4e60-9f9b-fdce327352e5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:30.220962 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1425/2834] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:30 2022] PUT /identity/v3/projects/ee08ef7c07e54ea3b003a8f71d2f0580/users/ded2828c845c4b40bccf484871f8c603/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:37:30.232486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9a6c-edda-4b65-ab6e-6d905fe7298b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:30.232746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9a6c-edda-4b65-ab6e-6d905fe7298b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:30.233017 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb9a6c-edda-4b65-ab6e-6d905fe7298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:30.263046 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5acb9a6c-edda-4b65-ab6e-6d905fe7298b None None] MFA Rules not processed for user `ded2828c845c4b40bccf484871f8c603`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:30.264300 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5acb9a6c-edda-4b65-ab6e-6d905fe7298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:30.333959 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1410/2835] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:30.345260 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb42eda-e87d-4e60-9f9b-fdce327352e5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:30.347118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1eb42eda-e87d-4e60-9f9b-fdce327352e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:30.389921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:30.404682 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb42eda-e87d-4e60-9f9b-fdce327352e5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:30.408486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2ede7-0257-4e75-8b9e-2735bf0221b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:30.409363 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2ede7-0257-4e75-8b9e-2735bf0221b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:30.409642 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2ede7-0257-4e75-8b9e-2735bf0221b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:30.409915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2ede7-0257-4e75-8b9e-2735bf0221b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:30.419318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2ede7-0257-4e75-8b9e-2735bf0221b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:30.422299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2ede7-0257-4e75-8b9e-2735bf0221b6 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:30.430661 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1426/2836] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:30.591057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb9a6c-edda-4b65-ab6e-6d905fe7298b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:30.600943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb9a6c-edda-4b65-ab6e-6d905fe7298b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:30.604467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bf479-33c9-4c4c-ad43-e63cd48b58d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:30.605060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf479-33c9-4c4c-ad43-e63cd48b58d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:30.605373 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf479-33c9-4c4c-ad43-e63cd48b58d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:30.605648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf479-33c9-4c4c-ad43-e63cd48b58d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:30.662754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bf479-33c9-4c4c-ad43-e63cd48b58d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:30.664151 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bf479-33c9-4c4c-ad43-e63cd48b58d7 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:30.673353 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1411/2837] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:34.083786 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2ede7-0257-4e75-8b9e-2735bf0221b6 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:34.145743 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2ede7-0257-4e75-8b9e-2735bf0221b6 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:34.150296 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:34.150913 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:34.151190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:34.151462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] PATH_INFO: `/v3/users/d87890184cb44b6d812688acd43d1ecd` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:34.152590 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87890184cb44b6d812688acd43d1ecd)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:34.154496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:34.305864 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87890184cb44b6d812688acd43d1ecd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:34.306515 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87890184cb44b6d812688acd43d1ecd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:34.388981 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87890184cb44b6d812688acd43d1ecd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:34.389538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87890184cb44b6d812688acd43d1ecd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:34.402379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87890184cb44b6d812688acd43d1ecd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:34.414984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1427/2838] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:34 2022] DELETE /identity/v3/users/d87890184cb44b6d812688acd43d1ecd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:34.419647 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9536a-d5cb-4dd6-8dbf-836c70dcb368 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:34.421346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9536a-d5cb-4dd6-8dbf-836c70dcb368 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:34.421346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9536a-d5cb-4dd6-8dbf-836c70dcb368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:34.439368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a1d9536a-d5cb-4dd6-8dbf-836c70dcb368 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:34.441052 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a1d9536a-d5cb-4dd6-8dbf-836c70dcb368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:34.492643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:34.500960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1412/2839] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:34.510907 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:34.512360 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:34.571257 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756b1f9-0773-47dd-85a2-e434b2a37498 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:34.574901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbcadc-4ff7-4ca7-b47f-5cce69ce309b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:34.575500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbcadc-4ff7-4ca7-b47f-5cce69ce309b service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:34.575802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbcadc-4ff7-4ca7-b47f-5cce69ce309b service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:34.576148 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbcadc-4ff7-4ca7-b47f-5cce69ce309b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:34.585953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbcadc-4ff7-4ca7-b47f-5cce69ce309b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:34.587368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbcadc-4ff7-4ca7-b47f-5cce69ce309b service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:34.597713 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1428/2840] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:34.979294 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9536a-d5cb-4dd6-8dbf-836c70dcb368 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:34.980737 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a1d9536a-d5cb-4dd6-8dbf-836c70dcb368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:34.993663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9536a-d5cb-4dd6-8dbf-836c70dcb368 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:34.998568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:34.999199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:34.999477 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:34.999767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] PATH_INFO: `/v3/projects/be89d1d8c092412c8ec1e3bcca8e1cd9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:35.000889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be89d1d8c092412c8ec1e3bcca8e1cd9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:35.003568 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:35.097489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be89d1d8c092412c8ec1e3bcca8e1cd9', 'request_id': 'req-0333b091-f1cd-4411-9f08-38c7b1920700'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.103499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be89d1d8c092412c8ec1e3bcca8e1cd9', 'request_id': 'req-0333b091-f1cd-4411-9f08-38c7b1920700'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.165934 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be89d1d8c092412c8ec1e3bcca8e1cd9', 'request_id': 'req-0333b091-f1cd-4411-9f08-38c7b1920700'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.176433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] The token cache is being invalidate because project be89d1d8c092412c8ec1e3bcca8e1cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:35.180580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.180580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.180580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1413/2841] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:34 2022] DELETE /identity/v3/projects/be89d1d8c092412c8ec1e3bcca8e1cd9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:35.182727 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbcadc-4ff7-4ca7-b47f-5cce69ce309b service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:35.187513 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:35.193275 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbcadc-4ff7-4ca7-b47f-5cce69ce309b service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:35.259703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:35.260440 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:35.260994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:35.260994 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] PATH_INFO: `/v3/users/ded2828c845c4b40bccf484871f8c603` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:35.262234 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded2828c845c4b40bccf484871f8c603)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:35.264503 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:35.424808 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded2828c845c4b40bccf484871f8c603'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.425449 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded2828c845c4b40bccf484871f8c603'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.497316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded2828c845c4b40bccf484871f8c603'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.498263 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded2828c845c4b40bccf484871f8c603'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.512905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6089419f-859d-4aa7-8c66-880157dce4b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded2828c845c4b40bccf484871f8c603'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:35.525857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1429/2842] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:35 2022] DELETE /identity/v3/users/ded2828c845c4b40bccf484871f8c603 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:35.956862 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:35.958538 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:35.972760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333b091-f1cd-4411-9f08-38c7b1920700 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:36.031843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:36.032400 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.032679 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.032952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] PATH_INFO: `/v3/projects/ee08ef7c07e54ea3b003a8f71d2f0580` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.034278 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee08ef7c07e54ea3b003a8f71d2f0580)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:36.036228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:36.138342 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee08ef7c07e54ea3b003a8f71d2f0580', 'request_id': 'req-ac03dece-3a15-4c9e-9212-35a43fb8e496'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:36.144746 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee08ef7c07e54ea3b003a8f71d2f0580', 'request_id': 'req-ac03dece-3a15-4c9e-9212-35a43fb8e496'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:36.217583 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee08ef7c07e54ea3b003a8f71d2f0580', 'request_id': 'req-ac03dece-3a15-4c9e-9212-35a43fb8e496'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:36.228635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] The token cache is being invalidate because project ee08ef7c07e54ea3b003a8f71d2f0580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:36.228920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:36.229559 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ac03dece-3a15-4c9e-9212-35a43fb8e496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:36.231025 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1414/2843] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:35 2022] DELETE /identity/v3/projects/ee08ef7c07e54ea3b003a8f71d2f0580 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:36.235972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7e688-d9a0-4635-87ee-db4e88904a30 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.236475 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7e688-d9a0-4635-87ee-db4e88904a30 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.236595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7e688-d9a0-4635-87ee-db4e88904a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.259559 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-61f7e688-d9a0-4635-87ee-db4e88904a30 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:36.260813 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-61f7e688-d9a0-4635-87ee-db4e88904a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:36.321230 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1430/2844] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:36.329138 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5e4c-cd6a-4f22-ab1e-6c6acbea8b87 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.329429 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5e4c-cd6a-4f22-ab1e-6c6acbea8b87 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.329741 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5e4c-cd6a-4f22-ab1e-6c6acbea8b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.350367 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ddbf5e4c-cd6a-4f22-ab1e-6c6acbea8b87 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:36.351567 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ddbf5e4c-cd6a-4f22-ab1e-6c6acbea8b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:36.359586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1415/2845] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:36.364710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7e688-d9a0-4635-87ee-db4e88904a30 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:36.374919 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7e688-d9a0-4635-87ee-db4e88904a30 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:36.379939 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb120d-f46d-42eb-bbdb-c446fa01222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:36.381492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb120d-f46d-42eb-bbdb-c446fa01222a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.381492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb120d-f46d-42eb-bbdb-c446fa01222a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.381492 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb120d-f46d-42eb-bbdb-c446fa01222a admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.381881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb120d-f46d-42eb-bbdb-c446fa01222a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:37:36.382181 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb120d-f46d-42eb-bbdb-c446fa01222a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:36.383857 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb120d-f46d-42eb-bbdb-c446fa01222a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:36.395564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1431/2846] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:37:36.399854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5e4c-cd6a-4f22-ab1e-6c6acbea8b87 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:36.409594 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5e4c-cd6a-4f22-ab1e-6c6acbea8b87 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:36.414335 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faa759-0da3-4056-8774-f8223007d4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:36.414924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faa759-0da3-4056-8774-f8223007d4be admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.415196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faa759-0da3-4056-8774-f8223007d4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.415461 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faa759-0da3-4056-8774-f8223007d4be admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.416172 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4faa759-0da3-4056-8774-f8223007d4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:36.418054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4faa759-0da3-4056-8774-f8223007d4be admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:36.422551 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:36.544700 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1416/2847] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:36 2022] POST /identity/v3/projects => generated 391 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:37:36.548628 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb120d-f46d-42eb-bbdb-c446fa01222a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:36.559207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb120d-f46d-42eb-bbdb-c446fa01222a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:36.563773 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:36.613998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b636c2-c1a9-4d87-a228-12461b84bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:36.614600 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b636c2-c1a9-4d87-a228-12461b84bebf admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.614876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b636c2-c1a9-4d87-a228-12461b84bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.615146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b636c2-c1a9-4d87-a228-12461b84bebf admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.615790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b636c2-c1a9-4d87-a228-12461b84bebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:36.617702 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b636c2-c1a9-4d87-a228-12461b84bebf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:36.748723 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1432/2848] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:36 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:36.753119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faa759-0da3-4056-8774-f8223007d4be admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:36.763322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faa759-0da3-4056-8774-f8223007d4be admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:36.768381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c99224-484b-4779-980a-1b22a8e183bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:36.769131 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c99224-484b-4779-980a-1b22a8e183bb admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.769430 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c99224-484b-4779-980a-1b22a8e183bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.769753 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c99224-484b-4779-980a-1b22a8e183bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.770691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c99224-484b-4779-980a-1b22a8e183bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:36.772298 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c99224-484b-4779-980a-1b22a8e183bb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:36.782053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1417/2849] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:36.786630 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b636c2-c1a9-4d87-a228-12461b84bebf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:36.796779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b636c2-c1a9-4d87-a228-12461b84bebf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:36.801462 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6ec8b-4fc0-4c40-a529-047dda1431e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:36.802046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ec8b-4fc0-4c40-a529-047dda1431e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.802322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ec8b-4fc0-4c40-a529-047dda1431e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.802594 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ec8b-4fc0-4c40-a529-047dda1431e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.803226 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6ec8b-4fc0-4c40-a529-047dda1431e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:36.804838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6ec8b-4fc0-4c40-a529-047dda1431e0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:36.815953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1433/2850] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:36.819941 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c99224-484b-4779-980a-1b22a8e183bb admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:36.829524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c99224-484b-4779-980a-1b22a8e183bb admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:36.834621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f331ee4-aaa8-42fb-89ed-24d91d36fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:36.835253 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f331ee4-aaa8-42fb-89ed-24d91d36fb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.835527 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f331ee4-aaa8-42fb-89ed-24d91d36fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.835826 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f331ee4-aaa8-42fb-89ed-24d91d36fb61 admin admin] PATH_INFO: `/v3/projects/55bac8bec4d348b59a00237cf64bf7e6/users/3e1cea4495d743ef8cfa95c4a7b3eca3/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.850897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f331ee4-aaa8-42fb-89ed-24d91d36fb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bac8bec4d348b59a00237cf64bf7e6, user_id=3e1cea4495d743ef8cfa95c4a7b3eca3, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:36.853589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f331ee4-aaa8-42fb-89ed-24d91d36fb61 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:36.948988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1418/2851] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:36 2022] PUT /identity/v3/projects/55bac8bec4d348b59a00237cf64bf7e6/users/3e1cea4495d743ef8cfa95c4a7b3eca3/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:37:36.959383 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cc29c-7be7-4548-bb5b-9af574872872 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:36.959662 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cc29c-7be7-4548-bb5b-9af574872872 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:36.959965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cc29c-7be7-4548-bb5b-9af574872872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:36.987992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fb3cc29c-7be7-4548-bb5b-9af574872872 None None] MFA Rules not processed for user `3e1cea4495d743ef8cfa95c4a7b3eca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:36.989200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fb3cc29c-7be7-4548-bb5b-9af574872872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:37.053292 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1434/2852] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:37.057863 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f331ee4-aaa8-42fb-89ed-24d91d36fb61 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:37.119721 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f331ee4-aaa8-42fb-89ed-24d91d36fb61 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:37.124345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fb489-ca99-44c8-a526-4accd029acf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:37.124938 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fb489-ca99-44c8-a526-4accd029acf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:37.125215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fb489-ca99-44c8-a526-4accd029acf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:37.125489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fb489-ca99-44c8-a526-4accd029acf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:37.126123 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fb489-ca99-44c8-a526-4accd029acf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:37.128144 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fb489-ca99-44c8-a526-4accd029acf0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:37.235713 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1419/2853] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:37 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:37.240552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cc29c-7be7-4548-bb5b-9af574872872 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:37.251382 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cc29c-7be7-4548-bb5b-9af574872872 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:37.307890 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2246b-3479-410d-aee3-a482a51926fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:37.308404 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2246b-3479-410d-aee3-a482a51926fd admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:37.308681 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2246b-3479-410d-aee3-a482a51926fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:37.309013 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2246b-3479-410d-aee3-a482a51926fd admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:37.309633 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2246b-3479-410d-aee3-a482a51926fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:37.311529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2246b-3479-410d-aee3-a482a51926fd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:37.428805 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1435/2854] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:37 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:37.432763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fb489-ca99-44c8-a526-4accd029acf0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:37.443156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fb489-ca99-44c8-a526-4accd029acf0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:37.447601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d42e8-b54b-4111-802d-e7c8f7578c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:37.448214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d42e8-b54b-4111-802d-e7c8f7578c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:37.448490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d42e8-b54b-4111-802d-e7c8f7578c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:37.448760 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d42e8-b54b-4111-802d-e7c8f7578c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:37.449392 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d42e8-b54b-4111-802d-e7c8f7578c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:37.451022 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d42e8-b54b-4111-802d-e7c8f7578c56 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:37.461997 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1420/2855] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:37.466083 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2246b-3479-410d-aee3-a482a51926fd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:37.476561 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2246b-3479-410d-aee3-a482a51926fd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:37.481028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef0e11-c469-44db-ad0d-8ee88fcf1c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:37.481663 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef0e11-c469-44db-ad0d-8ee88fcf1c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:37.481937 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef0e11-c469-44db-ad0d-8ee88fcf1c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:37.482207 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef0e11-c469-44db-ad0d-8ee88fcf1c89 admin admin] PATH_INFO: `/v3/projects/fd4f3881d0fa4f5cbd6dbcca0a2f329e/users/46af7f3bbbaa410b8d9f597df4ff9ef3/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:37.484401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:37.497459 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef0e11-c469-44db-ad0d-8ee88fcf1c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4f3881d0fa4f5cbd6dbcca0a2f329e, user_id=46af7f3bbbaa410b8d9f597df4ff9ef3, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:37.500172 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef0e11-c469-44db-ad0d-8ee88fcf1c89 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:37.572438 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1436/2856] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:37 2022] PUT /identity/v3/projects/fd4f3881d0fa4f5cbd6dbcca0a2f329e/users/46af7f3bbbaa410b8d9f597df4ff9ef3/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:37:37.576347 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d42e8-b54b-4111-802d-e7c8f7578c56 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:37.586915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d42e8-b54b-4111-802d-e7c8f7578c56 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:37.641663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fde83c-85da-4318-8539-84c386d077fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:37.642285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fde83c-85da-4318-8539-84c386d077fe admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:37.642563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fde83c-85da-4318-8539-84c386d077fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:37.643363 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fde83c-85da-4318-8539-84c386d077fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:37.644027 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fde83c-85da-4318-8539-84c386d077fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:37.645603 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fde83c-85da-4318-8539-84c386d077fe admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:37.655355 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1421/2857] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:37.660311 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef0e11-c469-44db-ad0d-8ee88fcf1c89 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:37.670623 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef0e11-c469-44db-ad0d-8ee88fcf1c89 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:37.675134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ac2ef-ff20-48fb-b591-2e8718f4d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:37.675791 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ac2ef-ff20-48fb-b591-2e8718f4d5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:37.676067 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ac2ef-ff20-48fb-b591-2e8718f4d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:37.676337 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ac2ef-ff20-48fb-b591-2e8718f4d5d1 admin admin] PATH_INFO: `/v3/projects/fd4f3881d0fa4f5cbd6dbcca0a2f329e/users/46af7f3bbbaa410b8d9f597df4ff9ef3/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:37.678225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ac2ef-ff20-48fb-b591-2e8718f4d5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4f3881d0fa4f5cbd6dbcca0a2f329e, user_id=46af7f3bbbaa410b8d9f597df4ff9ef3, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:37.680881 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ac2ef-ff20-48fb-b591-2e8718f4d5d1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:37.691053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1437/2858] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:37 2022] PUT /identity/v3/projects/fd4f3881d0fa4f5cbd6dbcca0a2f329e/users/46af7f3bbbaa410b8d9f597df4ff9ef3/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:37.756394 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746f88c-a452-49e3-b55b-eaee4eb2b3c3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:37.757029 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746f88c-a452-49e3-b55b-eaee4eb2b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:37.757343 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746f88c-a452-49e3-b55b-eaee4eb2b3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:37.785481 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7746f88c-a452-49e3-b55b-eaee4eb2b3c3 None None] MFA Rules not processed for user `46af7f3bbbaa410b8d9f597df4ff9ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:37.786678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7746f88c-a452-49e3-b55b-eaee4eb2b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:37.794646 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:37.864738 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1422/2859] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:37.875450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ac2ef-ff20-48fb-b591-2e8718f4d5d1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:37.877118 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-709ac2ef-ff20-48fb-b591-2e8718f4d5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:37.934879 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ac2ef-ff20-48fb-b591-2e8718f4d5d1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:37.938514 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4cd8f-efa1-4923-ab3c-925a28c76636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:37.939111 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4cd8f-efa1-4923-ab3c-925a28c76636 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:37.939391 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4cd8f-efa1-4923-ab3c-925a28c76636 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:37.940200 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4cd8f-efa1-4923-ab3c-925a28c76636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:37.949543 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4cd8f-efa1-4923-ab3c-925a28c76636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:37.950971 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4cd8f-efa1-4923-ab3c-925a28c76636 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:37.961219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1438/2860] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:38.007092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746f88c-a452-49e3-b55b-eaee4eb2b3c3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:38.008482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7746f88c-a452-49e3-b55b-eaee4eb2b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:38.020994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746f88c-a452-49e3-b55b-eaee4eb2b3c3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:38.024544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b3423-3aee-40ec-9ac1-c58339190136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:38.025132 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3423-3aee-40ec-9ac1-c58339190136 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:38.025411 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3423-3aee-40ec-9ac1-c58339190136 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:38.025677 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3423-3aee-40ec-9ac1-c58339190136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:38.081640 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b3423-3aee-40ec-9ac1-c58339190136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:38.083053 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b3423-3aee-40ec-9ac1-c58339190136 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:38.091756 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1423/2861] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:43.051309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4cd8f-efa1-4923-ab3c-925a28c76636 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:43.114564 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4cd8f-efa1-4923-ab3c-925a28c76636 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:43.119127 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:43.119764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:43.120041 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:43.120307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] PATH_INFO: `/v3/users/3e1cea4495d743ef8cfa95c4a7b3eca3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:43.121415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1cea4495d743ef8cfa95c4a7b3eca3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:43.123323 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:43.253211 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1cea4495d743ef8cfa95c4a7b3eca3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:43.254905 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1cea4495d743ef8cfa95c4a7b3eca3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:43.308906 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1cea4495d743ef8cfa95c4a7b3eca3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:43.309529 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1cea4495d743ef8cfa95c4a7b3eca3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:43.323093 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1cea4495d743ef8cfa95c4a7b3eca3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:43.356815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:43.356815 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1439/2862] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:43 2022] DELETE /identity/v3/users/3e1cea4495d743ef8cfa95c4a7b3eca3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:43.357057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c3bfa-5816-4ef7-8e7b-deace4528bde None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:43.357057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c3bfa-5816-4ef7-8e7b-deace4528bde None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:43.357057 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c3bfa-5816-4ef7-8e7b-deace4528bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:43.360056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-065c3bfa-5816-4ef7-8e7b-deace4528bde None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:43.361239 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-065c3bfa-5816-4ef7-8e7b-deace4528bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:43.420838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1424/2863] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:43.431376 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:43.432856 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:43.489538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a570f-b568-49a8-b17b-3e2d1ae9e349 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:43.493177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4744f-5737-4663-b864-7b96ab0b6cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:43.493771 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4744f-5737-4663-b864-7b96ab0b6cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:43.494046 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4744f-5737-4663-b864-7b96ab0b6cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:43.494316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4744f-5737-4663-b864-7b96ab0b6cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:43.503186 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4744f-5737-4663-b864-7b96ab0b6cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:43.505206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4744f-5737-4663-b864-7b96ab0b6cd5 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:43.514586 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1440/2864] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:43.956822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c3bfa-5816-4ef7-8e7b-deace4528bde None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:43.958329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-065c3bfa-5816-4ef7-8e7b-deace4528bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:43.971338 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c3bfa-5816-4ef7-8e7b-deace4528bde None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:43.976118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:43.976759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:43.977034 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:43.977428 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] PATH_INFO: `/v3/projects/55bac8bec4d348b59a00237cf64bf7e6` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:43.979360 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bac8bec4d348b59a00237cf64bf7e6)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:43.981467 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:44.086452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:44.093379 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bac8bec4d348b59a00237cf64bf7e6', 'request_id': 'req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.099787 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bac8bec4d348b59a00237cf64bf7e6', 'request_id': 'req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.172240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bac8bec4d348b59a00237cf64bf7e6', 'request_id': 'req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.183822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] The token cache is being invalidate because project 55bac8bec4d348b59a00237cf64bf7e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:44.184070 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.184709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.186205 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1425/2865] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:43 2022] DELETE /identity/v3/projects/55bac8bec4d348b59a00237cf64bf7e6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:44.190243 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4744f-5737-4663-b864-7b96ab0b6cd5 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:44.200894 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4744f-5737-4663-b864-7b96ab0b6cd5 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:44.257478 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:44.258108 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:44.258379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:44.258651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] PATH_INFO: `/v3/users/46af7f3bbbaa410b8d9f597df4ff9ef3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:44.259788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46af7f3bbbaa410b8d9f597df4ff9ef3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:44.263177 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:44.431244 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46af7f3bbbaa410b8d9f597df4ff9ef3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.431976 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46af7f3bbbaa410b8d9f597df4ff9ef3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.474322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46af7f3bbbaa410b8d9f597df4ff9ef3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.474897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46af7f3bbbaa410b8d9f597df4ff9ef3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.488816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb5d55d1-50ba-40bf-ab28-484419ec09a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46af7f3bbbaa410b8d9f597df4ff9ef3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:44.500839 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1441/2866] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:44 2022] DELETE /identity/v3/users/46af7f3bbbaa410b8d9f597df4ff9ef3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:44.945610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:44.947161 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:44.962158 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de683e3-273d-49a3-b6e0-8c9813a1ed4a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:45.026447 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:45.027013 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.027279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.027555 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] PATH_INFO: `/v3/projects/fd4f3881d0fa4f5cbd6dbcca0a2f329e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.028704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4f3881d0fa4f5cbd6dbcca0a2f329e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.030626 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.148108 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4f3881d0fa4f5cbd6dbcca0a2f329e', 'request_id': 'req-3267ec05-b768-4ff8-a464-4479189c1f17'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:45.154260 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4f3881d0fa4f5cbd6dbcca0a2f329e', 'request_id': 'req-3267ec05-b768-4ff8-a464-4479189c1f17'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:45.211224 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4f3881d0fa4f5cbd6dbcca0a2f329e', 'request_id': 'req-3267ec05-b768-4ff8-a464-4479189c1f17'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:45.222452 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] The token cache is being invalidate because project fd4f3881d0fa4f5cbd6dbcca0a2f329e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:45.223257 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:45.223584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3267ec05-b768-4ff8-a464-4479189c1f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:45.225103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1426/2867] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:44 2022] DELETE /identity/v3/projects/fd4f3881d0fa4f5cbd6dbcca0a2f329e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:45.230851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026195fe-dcf8-491c-8e76-40c47d7d9fb7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.231344 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026195fe-dcf8-491c-8e76-40c47d7d9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.231450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026195fe-dcf8-491c-8e76-40c47d7d9fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.251469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-026195fe-dcf8-491c-8e76-40c47d7d9fb7 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:45.257779 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-026195fe-dcf8-491c-8e76-40c47d7d9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:45.261599 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:45.313784 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1442/2868] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:45.321879 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd1687-87c8-4efb-be37-14d786ef4cd2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.323631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd1687-87c8-4efb-be37-14d786ef4cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.323631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd1687-87c8-4efb-be37-14d786ef4cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.342213 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-aefd1687-87c8-4efb-be37-14d786ef4cd2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:45.343426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aefd1687-87c8-4efb-be37-14d786ef4cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:45.351910 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1427/2869] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:45.356045 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026195fe-dcf8-491c-8e76-40c47d7d9fb7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:45.366359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026195fe-dcf8-491c-8e76-40c47d7d9fb7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:45.371035 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeda7a5-b2c5-4097-ba58-3539d5f3e269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:45.371636 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeda7a5-b2c5-4097-ba58-3539d5f3e269 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.372147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeda7a5-b2c5-4097-ba58-3539d5f3e269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.372816 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeda7a5-b2c5-4097-ba58-3539d5f3e269 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.373489 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeda7a5-b2c5-4097-ba58-3539d5f3e269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:37:45.373799 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeda7a5-b2c5-4097-ba58-3539d5f3e269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.375433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeda7a5-b2c5-4097-ba58-3539d5f3e269 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.387605 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1443/2870] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:37:45.391818 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd1687-87c8-4efb-be37-14d786ef4cd2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:45.401696 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd1687-87c8-4efb-be37-14d786ef4cd2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:45.406369 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd9d46-bc84-4bde-a6fd-56d4f815d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:45.406975 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd9d46-bc84-4bde-a6fd-56d4f815d2ad admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.407232 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd9d46-bc84-4bde-a6fd-56d4f815d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.407503 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd9d46-bc84-4bde-a6fd-56d4f815d2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.408168 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd9d46-bc84-4bde-a6fd-56d4f815d2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.410082 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd9d46-bc84-4bde-a6fd-56d4f815d2ad admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.492954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1428/2871] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:45 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:45.497012 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeda7a5-b2c5-4097-ba58-3539d5f3e269 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:45.507673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeda7a5-b2c5-4097-ba58-3539d5f3e269 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:45.564753 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4005d9-4a0d-4276-914f-6a3dc892212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:45.565357 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4005d9-4a0d-4276-914f-6a3dc892212e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.566151 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4005d9-4a0d-4276-914f-6a3dc892212e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.566421 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4005d9-4a0d-4276-914f-6a3dc892212e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.567049 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4005d9-4a0d-4276-914f-6a3dc892212e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.568992 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4005d9-4a0d-4276-914f-6a3dc892212e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.657379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1444/2872] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:45 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:45.663163 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd9d46-bc84-4bde-a6fd-56d4f815d2ad admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:45.676296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd9d46-bc84-4bde-a6fd-56d4f815d2ad admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:45.681296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83a0a-3dbc-4b26-bd3b-a55e49f102ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:45.681902 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83a0a-3dbc-4b26-bd3b-a55e49f102ac admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.682182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83a0a-3dbc-4b26-bd3b-a55e49f102ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.682455 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83a0a-3dbc-4b26-bd3b-a55e49f102ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.683099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be83a0a-3dbc-4b26-bd3b-a55e49f102ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.684739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be83a0a-3dbc-4b26-bd3b-a55e49f102ac admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.695346 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1429/2873] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:45.699345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4005d9-4a0d-4276-914f-6a3dc892212e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:45.710228 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4005d9-4a0d-4276-914f-6a3dc892212e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:45.714822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6f73f-7cc6-4a57-ae68-c20bfd57e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:45.715412 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6f73f-7cc6-4a57-ae68-c20bfd57e0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.715686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6f73f-7cc6-4a57-ae68-c20bfd57e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.715986 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6f73f-7cc6-4a57-ae68-c20bfd57e0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.716645 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6f73f-7cc6-4a57-ae68-c20bfd57e0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.718227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6f73f-7cc6-4a57-ae68-c20bfd57e0d4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.729119 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1445/2874] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:45.733204 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83a0a-3dbc-4b26-bd3b-a55e49f102ac admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:45.743188 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83a0a-3dbc-4b26-bd3b-a55e49f102ac admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:45.747851 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372f4a9-e159-47f2-bd74-f4c9b84d7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:45.748490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f4a9-e159-47f2-bd74-f4c9b84d7936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.748771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f4a9-e159-47f2-bd74-f4c9b84d7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.749043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f4a9-e159-47f2-bd74-f4c9b84d7936 admin admin] PATH_INFO: `/v3/projects/14286114372b4f59ae6c7758bc6f00c3/users/a6d11371453141c3adff009a82dbba47/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.763625 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f4a9-e159-47f2-bd74-f4c9b84d7936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14286114372b4f59ae6c7758bc6f00c3, user_id=a6d11371453141c3adff009a82dbba47, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:45.766336 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f4a9-e159-47f2-bd74-f4c9b84d7936 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:45.768669 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:45.868887 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1430/2875] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:45 2022] PUT /identity/v3/projects/14286114372b4f59ae6c7758bc6f00c3/users/a6d11371453141c3adff009a82dbba47/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:37:45.881612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f3dbe-b58c-4472-aa11-67f2640bf6a0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:45.881612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f3dbe-b58c-4472-aa11-67f2640bf6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:45.881612 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f3dbe-b58c-4472-aa11-67f2640bf6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:45.914991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4d6f3dbe-b58c-4472-aa11-67f2640bf6a0 None None] MFA Rules not processed for user `a6d11371453141c3adff009a82dbba47`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:45.916084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4d6f3dbe-b58c-4472-aa11-67f2640bf6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:45.979973 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1446/2876] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:45.984601 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372f4a9-e159-47f2-bd74-f4c9b84d7936 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:46.045968 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372f4a9-e159-47f2-bd74-f4c9b84d7936 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:46.051003 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a964f-fe3b-4d9f-b75c-3342b4b145c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:46.051610 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a964f-fe3b-4d9f-b75c-3342b4b145c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:46.051926 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a964f-fe3b-4d9f-b75c-3342b4b145c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:46.052199 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a964f-fe3b-4d9f-b75c-3342b4b145c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:46.052832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a964f-fe3b-4d9f-b75c-3342b4b145c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:46.054727 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a964f-fe3b-4d9f-b75c-3342b4b145c8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:46.150309 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1431/2877] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:45 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:37:46.154307 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f3dbe-b58c-4472-aa11-67f2640bf6a0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:46.165479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f3dbe-b58c-4472-aa11-67f2640bf6a0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:46.170076 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:46.222802 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b61af-6bdb-4f5d-8523-5c745a69d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:46.223409 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b61af-6bdb-4f5d-8523-5c745a69d786 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:46.223680 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b61af-6bdb-4f5d-8523-5c745a69d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:46.223979 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b61af-6bdb-4f5d-8523-5c745a69d786 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:46.224601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b61af-6bdb-4f5d-8523-5c745a69d786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:46.226497 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b61af-6bdb-4f5d-8523-5c745a69d786 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:46.321387 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1447/2878] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:46 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:46.325602 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a964f-fe3b-4d9f-b75c-3342b4b145c8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:46.336970 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a964f-fe3b-4d9f-b75c-3342b4b145c8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:46.341648 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836af026-b303-48e8-82b9-82647cb020a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:46.342245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836af026-b303-48e8-82b9-82647cb020a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:46.342524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836af026-b303-48e8-82b9-82647cb020a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:46.342803 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836af026-b303-48e8-82b9-82647cb020a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:46.343444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836af026-b303-48e8-82b9-82647cb020a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:46.345093 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836af026-b303-48e8-82b9-82647cb020a4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:46.355793 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1432/2879] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:46.363425 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b61af-6bdb-4f5d-8523-5c745a69d786 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:46.373930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b61af-6bdb-4f5d-8523-5c745a69d786 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:46.379082 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ebb71-35c3-4373-b2bf-d714d204efc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:46.379732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ebb71-35c3-4373-b2bf-d714d204efc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:46.380026 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ebb71-35c3-4373-b2bf-d714d204efc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:46.380295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ebb71-35c3-4373-b2bf-d714d204efc5 admin admin] PATH_INFO: `/v3/projects/74fabb1f859047e2a0bb9005c1973241/users/01618b97001c4064aaf4d8bc71853775/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:46.395768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ebb71-35c3-4373-b2bf-d714d204efc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fabb1f859047e2a0bb9005c1973241, user_id=01618b97001c4064aaf4d8bc71853775, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:46.398378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ebb71-35c3-4373-b2bf-d714d204efc5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:46.451276 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1448/2880] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:46 2022] PUT /identity/v3/projects/74fabb1f859047e2a0bb9005c1973241/users/01618b97001c4064aaf4d8bc71853775/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:46.455215 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836af026-b303-48e8-82b9-82647cb020a4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:46.465302 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836af026-b303-48e8-82b9-82647cb020a4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:46.521490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70ec01-84bb-4cc3-abee-1a87ab8f418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:46.522094 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70ec01-84bb-4cc3-abee-1a87ab8f418f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:46.522397 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70ec01-84bb-4cc3-abee-1a87ab8f418f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:46.522691 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70ec01-84bb-4cc3-abee-1a87ab8f418f admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:46.523322 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70ec01-84bb-4cc3-abee-1a87ab8f418f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:46.524931 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70ec01-84bb-4cc3-abee-1a87ab8f418f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:46.534560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1433/2881] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:37:46.538941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ebb71-35c3-4373-b2bf-d714d204efc5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:46.549261 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ebb71-35c3-4373-b2bf-d714d204efc5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:46.554585 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f26c9d-684e-435f-a261-2c4e4e447c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:46.555218 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f26c9d-684e-435f-a261-2c4e4e447c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:46.555494 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f26c9d-684e-435f-a261-2c4e4e447c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:46.555790 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f26c9d-684e-435f-a261-2c4e4e447c00 admin admin] PATH_INFO: `/v3/projects/74fabb1f859047e2a0bb9005c1973241/users/01618b97001c4064aaf4d8bc71853775/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:46.557703 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f26c9d-684e-435f-a261-2c4e4e447c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fabb1f859047e2a0bb9005c1973241, user_id=01618b97001c4064aaf4d8bc71853775, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:46.560704 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f26c9d-684e-435f-a261-2c4e4e447c00 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:46.571698 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1449/2882] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:46 2022] PUT /identity/v3/projects/74fabb1f859047e2a0bb9005c1973241/users/01618b97001c4064aaf4d8bc71853775/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:46.583009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788094a3-f5d5-41b5-bad4-2e9674143671 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:46.583444 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788094a3-f5d5-41b5-bad4-2e9674143671 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:46.583889 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788094a3-f5d5-41b5-bad4-2e9674143671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:46.611358 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-788094a3-f5d5-41b5-bad4-2e9674143671 None None] MFA Rules not processed for user `01618b97001c4064aaf4d8bc71853775`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:46.612580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-788094a3-f5d5-41b5-bad4-2e9674143671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:46.668182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:46.686894 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1434/2883] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:46.699552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f26c9d-684e-435f-a261-2c4e4e447c00 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:46.701250 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-21f26c9d-684e-435f-a261-2c4e4e447c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:46.758818 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f26c9d-684e-435f-a261-2c4e4e447c00 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:46.762638 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c21e1-a1a5-4031-90ff-02706fe54997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:46.763930 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c21e1-a1a5-4031-90ff-02706fe54997 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:46.764214 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c21e1-a1a5-4031-90ff-02706fe54997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:46.764483 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c21e1-a1a5-4031-90ff-02706fe54997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:46.773316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c21e1-a1a5-4031-90ff-02706fe54997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:46.774734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c21e1-a1a5-4031-90ff-02706fe54997 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:46.783812 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1450/2884] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:46.885563 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788094a3-f5d5-41b5-bad4-2e9674143671 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:46.895156 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788094a3-f5d5-41b5-bad4-2e9674143671 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:46.898845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb62af-cc3d-4083-a24a-3618c60bbf9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:46.899534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb62af-cc3d-4083-a24a-3618c60bbf9f service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:46.899843 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb62af-cc3d-4083-a24a-3618c60bbf9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:46.900119 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb62af-cc3d-4083-a24a-3618c60bbf9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:46.957490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb62af-cc3d-4083-a24a-3618c60bbf9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:46.959120 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb62af-cc3d-4083-a24a-3618c60bbf9f service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:46.968073 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1435/2885] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:50.128915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c21e1-a1a5-4031-90ff-02706fe54997 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:50.191219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c21e1-a1a5-4031-90ff-02706fe54997 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:50.196401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:50.197018 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:50.203033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:50.203033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] PATH_INFO: `/v3/users/a6d11371453141c3adff009a82dbba47` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:50.203033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d11371453141c3adff009a82dbba47)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:50.203033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:50.205303 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:50.356563 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d11371453141c3adff009a82dbba47'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:50.357136 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d11371453141c3adff009a82dbba47'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:50.445755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d11371453141c3adff009a82dbba47'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:50.446377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d11371453141c3adff009a82dbba47'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:50.458796 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d11371453141c3adff009a82dbba47'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:50.471027 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1451/2886] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:50 2022] DELETE /identity/v3/users/a6d11371453141c3adff009a82dbba47 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:50.476416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1efa62-e772-4aea-ab61-75b58ebd10da None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:50.476888 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1efa62-e772-4aea-ab61-75b58ebd10da None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:50.476987 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1efa62-e772-4aea-ab61-75b58ebd10da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:50.497799 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ba1efa62-e772-4aea-ab61-75b58ebd10da None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:50.501203 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ba1efa62-e772-4aea-ab61-75b58ebd10da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:50.557977 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1436/2887] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:50.567896 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:50.569308 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:50.624776 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710c597-f562-4b05-a286-a2a7053fa4d4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:50.628428 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062a7d2-4e50-448f-a55a-11d62773f561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:50.629034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062a7d2-4e50-448f-a55a-11d62773f561 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:50.629316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062a7d2-4e50-448f-a55a-11d62773f561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:50.629616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062a7d2-4e50-448f-a55a-11d62773f561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:50.638842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062a7d2-4e50-448f-a55a-11d62773f561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:50.640319 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062a7d2-4e50-448f-a55a-11d62773f561 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:50.649770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1452/2888] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:51.076922 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1efa62-e772-4aea-ab61-75b58ebd10da None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:51.078506 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ba1efa62-e772-4aea-ab61-75b58ebd10da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:51.093314 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1efa62-e772-4aea-ab61-75b58ebd10da None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:51.097939 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:51.098560 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:51.098841 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:51.099668 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] PATH_INFO: `/v3/projects/14286114372b4f59ae6c7758bc6f00c3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:51.101844 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14286114372b4f59ae6c7758bc6f00c3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:51.103784 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:51.234420 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14286114372b4f59ae6c7758bc6f00c3', 'request_id': 'req-07313901-ec1b-4882-8aa3-9cd301dec808'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.240504 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14286114372b4f59ae6c7758bc6f00c3', 'request_id': 'req-07313901-ec1b-4882-8aa3-9cd301dec808'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.325991 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14286114372b4f59ae6c7758bc6f00c3', 'request_id': 'req-07313901-ec1b-4882-8aa3-9cd301dec808'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.337598 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] The token cache is being invalidate because project 14286114372b4f59ae6c7758bc6f00c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:51.337884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.338503 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.340033 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1437/2889] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:51 2022] DELETE /identity/v3/projects/14286114372b4f59ae6c7758bc6f00c3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:51.344034 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062a7d2-4e50-448f-a55a-11d62773f561 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:51.354346 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062a7d2-4e50-448f-a55a-11d62773f561 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:51.414419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:51.415078 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:51.415359 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:51.415788 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] PATH_INFO: `/v3/users/01618b97001c4064aaf4d8bc71853775` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:51.416933 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=01618b97001c4064aaf4d8bc71853775)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:51.418887 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:51.510479 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:51.625601 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01618b97001c4064aaf4d8bc71853775'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.626290 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01618b97001c4064aaf4d8bc71853775'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.725233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01618b97001c4064aaf4d8bc71853775'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.726064 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01618b97001c4064aaf4d8bc71853775'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.744991 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b28b85e8-c6e8-429b-962c-705cf2858f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01618b97001c4064aaf4d8bc71853775'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:51.758086 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1453/2890] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:37:51 2022] DELETE /identity/v3/users/01618b97001c4064aaf4d8bc71853775 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:52.185229 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:52.186813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:52.204194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07313901-ec1b-4882-8aa3-9cd301dec808 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:52.214270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:52.263371 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:52.264078 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:52.264360 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:52.264635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] PATH_INFO: `/v3/projects/74fabb1f859047e2a0bb9005c1973241` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:52.265778 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=74fabb1f859047e2a0bb9005c1973241)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:52.267675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:52.388116 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74fabb1f859047e2a0bb9005c1973241', 'request_id': 'req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:52.394478 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74fabb1f859047e2a0bb9005c1973241', 'request_id': 'req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:52.474319 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74fabb1f859047e2a0bb9005c1973241', 'request_id': 'req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:52.486472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] The token cache is being invalidate because project 74fabb1f859047e2a0bb9005c1973241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:37:52.489612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:52.489612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-01f90bcc-ef18-4aa9-97e6-8d53671ba51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:37:52.489612 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1438/2891] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:37:52 2022] DELETE /identity/v3/projects/74fabb1f859047e2a0bb9005c1973241 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:52.493901 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a16fc9-fe49-43ca-8a41-2edd241d5fe5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:52.494389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a16fc9-fe49-43ca-8a41-2edd241d5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:52.494498 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a16fc9-fe49-43ca-8a41-2edd241d5fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:52.513940 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-50a16fc9-fe49-43ca-8a41-2edd241d5fe5 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:52.515126 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-50a16fc9-fe49-43ca-8a41-2edd241d5fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:52.574552 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1454/2892] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:52.582273 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235038-bc9a-4fd2-843f-b2f1071c50c2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:52.582561 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235038-bc9a-4fd2-843f-b2f1071c50c2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:52.582839 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235038-bc9a-4fd2-843f-b2f1071c50c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:52.603883 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7f235038-bc9a-4fd2-843f-b2f1071c50c2 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:52.605081 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7f235038-bc9a-4fd2-843f-b2f1071c50c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:52.612898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1439/2893] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:52.617281 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a16fc9-fe49-43ca-8a41-2edd241d5fe5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:52.626811 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a16fc9-fe49-43ca-8a41-2edd241d5fe5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:52.631997 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccf54b-9882-41c3-b7f6-069a34832ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:52.632677 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf54b-9882-41c3-b7f6-069a34832ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:52.632950 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf54b-9882-41c3-b7f6-069a34832ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:52.633219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf54b-9882-41c3-b7f6-069a34832ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:52.633860 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccf54b-9882-41c3-b7f6-069a34832ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:37:52.634158 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccf54b-9882-41c3-b7f6-069a34832ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:52.635770 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccf54b-9882-41c3-b7f6-069a34832ce2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:52.646874 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1455/2894] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:37:52.651812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f235038-bc9a-4fd2-843f-b2f1071c50c2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:52.661011 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f235038-bc9a-4fd2-843f-b2f1071c50c2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:52.665967 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b84484-f4eb-4e37-b7c5-2118bd035f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:52.666642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b84484-f4eb-4e37-b7c5-2118bd035f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:52.666923 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b84484-f4eb-4e37-b7c5-2118bd035f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:52.667194 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b84484-f4eb-4e37-b7c5-2118bd035f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:52.667873 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b84484-f4eb-4e37-b7c5-2118bd035f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:52.669769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b84484-f4eb-4e37-b7c5-2118bd035f6d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:52.784739 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1440/2895] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:52 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:52.788893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccf54b-9882-41c3-b7f6-069a34832ce2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:52.798909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccf54b-9882-41c3-b7f6-069a34832ce2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:52.856710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287e323-c25c-45b5-9c04-15b9c574e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:52.857232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287e323-c25c-45b5-9c04-15b9c574e7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:52.857622 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287e323-c25c-45b5-9c04-15b9c574e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:52.857900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287e323-c25c-45b5-9c04-15b9c574e7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:52.858518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287e323-c25c-45b5-9c04-15b9c574e7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:52.860611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287e323-c25c-45b5-9c04-15b9c574e7a8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:52.976824 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1456/2896] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:52 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:52.980957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b84484-f4eb-4e37-b7c5-2118bd035f6d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:52.991553 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b84484-f4eb-4e37-b7c5-2118bd035f6d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:52.996173 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbcfe7-e77f-4a89-b195-9fa9916ad7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.013387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbcfe7-e77f-4a89-b195-9fa9916ad7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.013387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbcfe7-e77f-4a89-b195-9fa9916ad7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.013387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbcfe7-e77f-4a89-b195-9fa9916ad7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.013387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbcfe7-e77f-4a89-b195-9fa9916ad7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.013387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbcfe7-e77f-4a89-b195-9fa9916ad7bc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.013387 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1441/2897] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:53.016124 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287e323-c25c-45b5-9c04-15b9c574e7a8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.027050 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287e323-c25c-45b5-9c04-15b9c574e7a8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.031671 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ae57d-9e96-41d0-85a5-e3cdb55ec07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.032287 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae57d-9e96-41d0-85a5-e3cdb55ec07d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.032565 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae57d-9e96-41d0-85a5-e3cdb55ec07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.032840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae57d-9e96-41d0-85a5-e3cdb55ec07d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.033481 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ae57d-9e96-41d0-85a5-e3cdb55ec07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.035059 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ae57d-9e96-41d0-85a5-e3cdb55ec07d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.045591 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1457/2898] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:53.049658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbcfe7-e77f-4a89-b195-9fa9916ad7bc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.060009 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbcfe7-e77f-4a89-b195-9fa9916ad7bc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.064480 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7e071-f9b0-4767-9120-38b1807d849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.065118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e071-f9b0-4767-9120-38b1807d849b admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.065396 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e071-f9b0-4767-9120-38b1807d849b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.065672 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7e071-f9b0-4767-9120-38b1807d849b admin admin] PATH_INFO: `/v3/projects/f5886ff7600e45b88403967eb9cdcb19/users/0054ba41def54922ba3178d33611fb1f/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.081491 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7e071-f9b0-4767-9120-38b1807d849b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5886ff7600e45b88403967eb9cdcb19, user_id=0054ba41def54922ba3178d33611fb1f, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.084266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7e071-f9b0-4767-9120-38b1807d849b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.153900 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1442/2899] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:53 2022] PUT /identity/v3/projects/f5886ff7600e45b88403967eb9cdcb19/users/0054ba41def54922ba3178d33611fb1f/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:53.165745 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300d225-0013-4cfe-a839-5e73c0a1b453 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.166028 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300d225-0013-4cfe-a839-5e73c0a1b453 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.166299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300d225-0013-4cfe-a839-5e73c0a1b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.188088 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:53.196595 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a300d225-0013-4cfe-a839-5e73c0a1b453 None None] MFA Rules not processed for user `0054ba41def54922ba3178d33611fb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:53.198690 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a300d225-0013-4cfe-a839-5e73c0a1b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:53.263384 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1458/2900] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:37:53.268056 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7e071-f9b0-4767-9120-38b1807d849b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.309574 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:53.331209 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7e071-f9b0-4767-9120-38b1807d849b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.336528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb02f24-5a13-4626-8166-4c07411f4b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.337192 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb02f24-5a13-4626-8166-4c07411f4b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.337499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb02f24-5a13-4626-8166-4c07411f4b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.337771 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb02f24-5a13-4626-8166-4c07411f4b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.338391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb02f24-5a13-4626-8166-4c07411f4b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.340324 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb02f24-5a13-4626-8166-4c07411f4b0e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.401649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1443/2901] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:53 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:53.405525 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300d225-0013-4cfe-a839-5e73c0a1b453 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.416809 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300d225-0013-4cfe-a839-5e73c0a1b453 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.470854 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d86237-821b-41fd-b367-e08cee04aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.471453 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d86237-821b-41fd-b367-e08cee04aae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.471729 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d86237-821b-41fd-b367-e08cee04aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.472033 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d86237-821b-41fd-b367-e08cee04aae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.472660 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d86237-821b-41fd-b367-e08cee04aae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.474567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d86237-821b-41fd-b367-e08cee04aae3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.594195 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1459/2902] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:53 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:53.598266 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb02f24-5a13-4626-8166-4c07411f4b0e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.608946 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb02f24-5a13-4626-8166-4c07411f4b0e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.613468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871213c-6399-4806-a52f-43a449ce4787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.614067 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871213c-6399-4806-a52f-43a449ce4787 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.614325 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871213c-6399-4806-a52f-43a449ce4787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.614592 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871213c-6399-4806-a52f-43a449ce4787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.615223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871213c-6399-4806-a52f-43a449ce4787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.616847 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871213c-6399-4806-a52f-43a449ce4787 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.627226 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1444/2903] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:53.631374 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d86237-821b-41fd-b367-e08cee04aae3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.641443 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d86237-821b-41fd-b367-e08cee04aae3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.646053 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67a2fc-ad9e-4839-951d-41e97b8d1523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.646639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67a2fc-ad9e-4839-951d-41e97b8d1523 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.646915 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67a2fc-ad9e-4839-951d-41e97b8d1523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.647184 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67a2fc-ad9e-4839-951d-41e97b8d1523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.647851 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67a2fc-ad9e-4839-951d-41e97b8d1523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.649540 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67a2fc-ad9e-4839-951d-41e97b8d1523 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.659531 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1460/2904] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:53.663701 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871213c-6399-4806-a52f-43a449ce4787 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.674210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871213c-6399-4806-a52f-43a449ce4787 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.678772 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c4c0-d293-4edc-b9fb-31f6bdf3fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.679405 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c4c0-d293-4edc-b9fb-31f6bdf3fc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.680422 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c4c0-d293-4edc-b9fb-31f6bdf3fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.680734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804c4c0-d293-4edc-b9fb-31f6bdf3fc0a admin admin] PATH_INFO: `/v3/projects/291b2b541e79471baf70cf2a4875974b/users/def4853a9b6348fba8ca05afcdf4c738/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.695223 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804c4c0-d293-4edc-b9fb-31f6bdf3fc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=291b2b541e79471baf70cf2a4875974b, user_id=def4853a9b6348fba8ca05afcdf4c738, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.698166 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804c4c0-d293-4edc-b9fb-31f6bdf3fc0a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:53.811896 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1445/2905] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:53 2022] PUT /identity/v3/projects/291b2b541e79471baf70cf2a4875974b/users/def4853a9b6348fba8ca05afcdf4c738/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:53.822518 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09528f-4a09-4120-bc3e-5425b24d2872 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.822876 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09528f-4a09-4120-bc3e-5425b24d2872 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.823095 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09528f-4a09-4120-bc3e-5425b24d2872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.850913 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bd09528f-4a09-4120-bc3e-5425b24d2872 None None] MFA Rules not processed for user `def4853a9b6348fba8ca05afcdf4c738`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:53.852847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bd09528f-4a09-4120-bc3e-5425b24d2872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:53.915297 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1461/2906] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:37:53.919716 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c4c0-d293-4edc-b9fb-31f6bdf3fc0a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:53.982911 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804c4c0-d293-4edc-b9fb-31f6bdf3fc0a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:53.987792 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c599f-5c26-43d8-b3ce-f6840632822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:53.988399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c599f-5c26-43d8-b3ce-f6840632822d admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:53.988675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c599f-5c26-43d8-b3ce-f6840632822d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:53.988943 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c599f-5c26-43d8-b3ce-f6840632822d admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:53.989580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c599f-5c26-43d8-b3ce-f6840632822d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:53.991586 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c599f-5c26-43d8-b3ce-f6840632822d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:54.098189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1446/2907] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:37:53 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:37:54.103084 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09528f-4a09-4120-bc3e-5425b24d2872 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:54.113696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09528f-4a09-4120-bc3e-5425b24d2872 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:54.118909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:54.171630 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aaa47-efb2-4645-af57-9cc168450930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:54.172188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aaa47-efb2-4645-af57-9cc168450930 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:54.172469 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aaa47-efb2-4645-af57-9cc168450930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:54.172760 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aaa47-efb2-4645-af57-9cc168450930 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:54.173379 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86aaa47-efb2-4645-af57-9cc168450930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:54.175295 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86aaa47-efb2-4645-af57-9cc168450930 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:54.251676 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1462/2908] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:37:54 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:37:54.255658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c599f-5c26-43d8-b3ce-f6840632822d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:54.266884 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c599f-5c26-43d8-b3ce-f6840632822d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:54.271578 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837f9dd-e3df-4c80-b8b2-b5008785fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:54.272210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837f9dd-e3df-4c80-b8b2-b5008785fb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:54.272482 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837f9dd-e3df-4c80-b8b2-b5008785fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:54.272754 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837f9dd-e3df-4c80-b8b2-b5008785fb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:54.274023 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837f9dd-e3df-4c80-b8b2-b5008785fb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:54.276035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837f9dd-e3df-4c80-b8b2-b5008785fb41 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:54.287105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1447/2909] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:54.296550 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aaa47-efb2-4645-af57-9cc168450930 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:54.306765 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aaa47-efb2-4645-af57-9cc168450930 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:54.311611 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073aa8-5711-4fc8-a520-56dd568a3d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:54.314036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073aa8-5711-4fc8-a520-56dd568a3d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:54.314036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073aa8-5711-4fc8-a520-56dd568a3d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:54.314036 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073aa8-5711-4fc8-a520-56dd568a3d9d admin admin] PATH_INFO: `/v3/projects/3735e25286e746c79a8ab7dc52748f2a/users/0dc293b017224541974ae1d8706e1305/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:54.328176 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53073aa8-5711-4fc8-a520-56dd568a3d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3735e25286e746c79a8ab7dc52748f2a, user_id=0dc293b017224541974ae1d8706e1305, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:54.330814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53073aa8-5711-4fc8-a520-56dd568a3d9d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:54.393814 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1463/2910] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:54 2022] PUT /identity/v3/projects/3735e25286e746c79a8ab7dc52748f2a/users/0dc293b017224541974ae1d8706e1305/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:37:54.397966 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837f9dd-e3df-4c80-b8b2-b5008785fb41 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:54.408652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837f9dd-e3df-4c80-b8b2-b5008785fb41 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:54.464303 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b38c3-adc0-410a-8b63-0d777a620fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:54.464832 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b38c3-adc0-410a-8b63-0d777a620fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:54.465111 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b38c3-adc0-410a-8b63-0d777a620fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:54.465385 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b38c3-adc0-410a-8b63-0d777a620fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:54.466018 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b38c3-adc0-410a-8b63-0d777a620fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:54.467597 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b38c3-adc0-410a-8b63-0d777a620fc7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:54.469664 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:54.477636 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1448/2911] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:37:54.482259 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073aa8-5711-4fc8-a520-56dd568a3d9d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:54.495096 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073aa8-5711-4fc8-a520-56dd568a3d9d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:54.500724 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088be8b-000e-4faf-92eb-c541b784d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:54.501321 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088be8b-000e-4faf-92eb-c541b784d432 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:54.501567 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088be8b-000e-4faf-92eb-c541b784d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:54.501897 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088be8b-000e-4faf-92eb-c541b784d432 admin admin] PATH_INFO: `/v3/projects/3735e25286e746c79a8ab7dc52748f2a/users/0dc293b017224541974ae1d8706e1305/roles/55aed406476a485f99f9815f9f27cb3b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:54.503836 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088be8b-000e-4faf-92eb-c541b784d432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3735e25286e746c79a8ab7dc52748f2a, user_id=0dc293b017224541974ae1d8706e1305, role_id=55aed406476a485f99f9815f9f27cb3b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:54.506755 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088be8b-000e-4faf-92eb-c541b784d432 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:54.518914 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1464/2912] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:37:54 2022] PUT /identity/v3/projects/3735e25286e746c79a8ab7dc52748f2a/users/0dc293b017224541974ae1d8706e1305/roles/55aed406476a485f99f9815f9f27cb3b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:37:54.530230 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a6b4-127b-478e-8b23-8b1445b3b316 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:54.530635 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a6b4-127b-478e-8b23-8b1445b3b316 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:54.531127 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a6b4-127b-478e-8b23-8b1445b3b316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:54.562307 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-df46a6b4-127b-478e-8b23-8b1445b3b316 None None] MFA Rules not processed for user `0dc293b017224541974ae1d8706e1305`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:37:54.563652 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-df46a6b4-127b-478e-8b23-8b1445b3b316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:54.638059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1449/2913] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:37:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:37:54.649522 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088be8b-000e-4faf-92eb-c541b784d432 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:54.651215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3088be8b-000e-4faf-92eb-c541b784d432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:54.709747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088be8b-000e-4faf-92eb-c541b784d432 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:54.713998 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57dc7b-05fb-4889-b1c7-f972f7265746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:54.714652 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57dc7b-05fb-4889-b1c7-f972f7265746 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:54.714872 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57dc7b-05fb-4889-b1c7-f972f7265746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:54.715147 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57dc7b-05fb-4889-b1c7-f972f7265746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:54.771769 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57dc7b-05fb-4889-b1c7-f972f7265746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:54.773217 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57dc7b-05fb-4889-b1c7-f972f7265746 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:54.782909 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1465/2914] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:56.683629 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46a6b4-127b-478e-8b23-8b1445b3b316 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:56.685096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-df46a6b4-127b-478e-8b23-8b1445b3b316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:37:56.698077 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46a6b4-127b-478e-8b23-8b1445b3b316 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:56.701675 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cd769-34f3-4dde-8891-4e1989e000f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:56.702268 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cd769-34f3-4dde-8891-4e1989e000f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:56.702544 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cd769-34f3-4dde-8891-4e1989e000f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:56.702813 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cd769-34f3-4dde-8891-4e1989e000f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:56.758954 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cd769-34f3-4dde-8891-4e1989e000f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:56.760416 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cd769-34f3-4dde-8891-4e1989e000f6 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:56.769522 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1450/2915] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:37:58.064368 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57dc7b-05fb-4889-b1c7-f972f7265746 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:37:58.073911 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57dc7b-05fb-4889-b1c7-f972f7265746 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:37:58.077548 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5e15b-7343-41fe-9658-1ce69b5ad8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:37:58.078137 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5e15b-7343-41fe-9658-1ce69b5ad8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:37:58.078415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5e15b-7343-41fe-9658-1ce69b5ad8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:37:58.078687 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5e15b-7343-41fe-9658-1ce69b5ad8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:37:58.088318 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5e15b-7343-41fe-9658-1ce69b5ad8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:37:58.089734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5e15b-7343-41fe-9658-1ce69b5ad8e0 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:37:58.098932 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1466/2916] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:37:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:02.569854 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cd769-34f3-4dde-8891-4e1989e000f6 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:02.630876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cd769-34f3-4dde-8891-4e1989e000f6 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:02.636117 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:02.636770 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:02.637047 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:02.637317 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] PATH_INFO: `/v3/users/0054ba41def54922ba3178d33611fb1f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:02.638451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0054ba41def54922ba3178d33611fb1f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:02.640426 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:02.662965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:02.879179 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0054ba41def54922ba3178d33611fb1f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:02.886689 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0054ba41def54922ba3178d33611fb1f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:02.898407 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0054ba41def54922ba3178d33611fb1f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:02.899096 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0054ba41def54922ba3178d33611fb1f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:02.899766 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0054ba41def54922ba3178d33611fb1f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:02.971255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1451/2917] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:38:02 2022] DELETE /identity/v3/users/0054ba41def54922ba3178d33611fb1f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:02.975840 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7839-ec41-4b41-94c5-d56d2ff89f13 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:02.976322 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7839-ec41-4b41-94c5-d56d2ff89f13 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:02.976435 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7839-ec41-4b41-94c5-d56d2ff89f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:02.983598 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:02.997102 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-dccf7839-ec41-4b41-94c5-d56d2ff89f13 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:02.998578 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dccf7839-ec41-4b41-94c5-d56d2ff89f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:03.057134 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1467/2918] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:03.067912 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:03.069380 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:03.127001 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eeb3c-fc44-4603-897b-6fac617e159e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:03.130623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50805d65-8434-4664-b9fa-15e780595b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:03.131144 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50805d65-8434-4664-b9fa-15e780595b0e service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:03.131419 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50805d65-8434-4664-b9fa-15e780595b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:03.131687 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50805d65-8434-4664-b9fa-15e780595b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:03.141988 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50805d65-8434-4664-b9fa-15e780595b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:03.143399 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50805d65-8434-4664-b9fa-15e780595b0e service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:03.152901 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1452/2919] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:03.544744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf7839-ec41-4b41-94c5-d56d2ff89f13 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:03.546299 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dccf7839-ec41-4b41-94c5-d56d2ff89f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:03.558985 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf7839-ec41-4b41-94c5-d56d2ff89f13 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:03.563708 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:03.564370 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:03.564643 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:03.564910 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] PATH_INFO: `/v3/projects/f5886ff7600e45b88403967eb9cdcb19` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:03.566289 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5886ff7600e45b88403967eb9cdcb19)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:03.568227 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:03.667558 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5886ff7600e45b88403967eb9cdcb19', 'request_id': 'req-74b39edc-8b8c-48d4-adee-ab34917819e8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:03.673539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5886ff7600e45b88403967eb9cdcb19', 'request_id': 'req-74b39edc-8b8c-48d4-adee-ab34917819e8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:03.679262 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5886ff7600e45b88403967eb9cdcb19', 'request_id': 'req-74b39edc-8b8c-48d4-adee-ab34917819e8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:03.764838 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] The token cache is being invalidate because project f5886ff7600e45b88403967eb9cdcb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:38:03.765123 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:03.765842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:03.767389 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1468/2920] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:38:03 2022] DELETE /identity/v3/projects/f5886ff7600e45b88403967eb9cdcb19 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:03.771433 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50805d65-8434-4664-b9fa-15e780595b0e service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:03.781200 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50805d65-8434-4664-b9fa-15e780595b0e service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:03.836621 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:03.837245 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:03.837524 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:03.837798 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] PATH_INFO: `/v3/users/def4853a9b6348fba8ca05afcdf4c738` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:03.839228 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=def4853a9b6348fba8ca05afcdf4c738)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:03.841154 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:03.994348 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:03.996584 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def4853a9b6348fba8ca05afcdf4c738'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.004534 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def4853a9b6348fba8ca05afcdf4c738'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.017074 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def4853a9b6348fba8ca05afcdf4c738'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.018985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def4853a9b6348fba8ca05afcdf4c738'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.018985 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def4853a9b6348fba8ca05afcdf4c738'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.096707 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1453/2921] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:38:03 2022] DELETE /identity/v3/users/def4853a9b6348fba8ca05afcdf4c738 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:04.489444 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:04.490953 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:04.504575 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b39edc-8b8c-48d4-adee-ab34917819e8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:04.563245 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:04.563900 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:04.564174 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:04.564441 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] PATH_INFO: `/v3/projects/291b2b541e79471baf70cf2a4875974b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:04.565535 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=291b2b541e79471baf70cf2a4875974b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:04.567686 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:04.705655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:04.721738 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291b2b541e79471baf70cf2a4875974b', 'request_id': 'req-3e6a1511-bffa-4c53-bc58-59f94c661a7a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.728055 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291b2b541e79471baf70cf2a4875974b', 'request_id': 'req-3e6a1511-bffa-4c53-bc58-59f94c661a7a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.733720 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291b2b541e79471baf70cf2a4875974b', 'request_id': 'req-3e6a1511-bffa-4c53-bc58-59f94c661a7a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.840327 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] The token cache is being invalidate because project 291b2b541e79471baf70cf2a4875974b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:38:04.840539 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.841169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:04.842665 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1469/2922] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:38:04 2022] DELETE /identity/v3/projects/291b2b541e79471baf70cf2a4875974b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:04.846734 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:04.848234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:04.861244 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7382-13e6-47e7-b84a-b86b1f3c48bb admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:04.918573 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:04.919189 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:04.919472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:04.919769 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] PATH_INFO: `/v3/users/0dc293b017224541974ae1d8706e1305` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:04.920899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc293b017224541974ae1d8706e1305)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:04.922810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:05.108562 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc293b017224541974ae1d8706e1305'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.115313 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc293b017224541974ae1d8706e1305'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.127490 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc293b017224541974ae1d8706e1305'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.128182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc293b017224541974ae1d8706e1305'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.128804 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1122e9a4-a17b-47dc-9b55-1442e5284d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc293b017224541974ae1d8706e1305'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.199875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1454/2923] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:38:04 2022] DELETE /identity/v3/users/0dc293b017224541974ae1d8706e1305 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:05.578129 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:05.583883 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:05.592781 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a1511-bffa-4c53-bc58-59f94c661a7a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:05.652378 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:05.652926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:05.653203 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:05.653474 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] PATH_INFO: `/v3/projects/3735e25286e746c79a8ab7dc52748f2a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:05.654616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3735e25286e746c79a8ab7dc52748f2a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:05.656652 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:05.783544 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3735e25286e746c79a8ab7dc52748f2a', 'request_id': 'req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.789794 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3735e25286e746c79a8ab7dc52748f2a', 'request_id': 'req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.796655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3735e25286e746c79a8ab7dc52748f2a', 'request_id': 'req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.850356 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] The token cache is being invalidate because project 3735e25286e746c79a8ab7dc52748f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:38:05.850673 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.851270 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8b30e454-e8dc-4806-a5b5-9b1b5a233fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:38:05.852761 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1470/2924] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:38:05 2022] DELETE /identity/v3/projects/3735e25286e746c79a8ab7dc52748f2a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:05.858566 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055818a-d483-430f-a0b7-9f98a1edcce0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:05.859097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055818a-d483-430f-a0b7-9f98a1edcce0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:05.859214 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055818a-d483-430f-a0b7-9f98a1edcce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:05.887381 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8055818a-d483-430f-a0b7-9f98a1edcce0 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:05.888618 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8055818a-d483-430f-a0b7-9f98a1edcce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:05.927331 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:05.947446 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1455/2925] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:05.955656 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d66ed6-3e77-48f2-9bee-f360d3b9ced3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:05.955977 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d66ed6-3e77-48f2-9bee-f360d3b9ced3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:05.961233 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d66ed6-3e77-48f2-9bee-f360d3b9ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:05.977701 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-59d66ed6-3e77-48f2-9bee-f360d3b9ced3 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:05.978918 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-59d66ed6-3e77-48f2-9bee-f360d3b9ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:05.987712 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1471/2926] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:05.991877 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055818a-d483-430f-a0b7-9f98a1edcce0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:06.001611 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055818a-d483-430f-a0b7-9f98a1edcce0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:06.006097 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04d2ad-21c9-48f0-88d5-82e57ae9901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:06.006717 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04d2ad-21c9-48f0-88d5-82e57ae9901c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:06.006995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04d2ad-21c9-48f0-88d5-82e57ae9901c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:06.007267 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04d2ad-21c9-48f0-88d5-82e57ae9901c admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:06.007979 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04d2ad-21c9-48f0-88d5-82e57ae9901c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:38:06.008282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04d2ad-21c9-48f0-88d5-82e57ae9901c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:06.009870 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04d2ad-21c9-48f0-88d5-82e57ae9901c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:06.021435 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1456/2927] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Aug 31 11:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:38:06.025596 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d66ed6-3e77-48f2-9bee-f360d3b9ced3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:06.035450 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d66ed6-3e77-48f2-9bee-f360d3b9ced3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:06.039972 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e377-e59a-4cba-ac2a-e38df231dbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:06.040557 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e377-e59a-4cba-ac2a-e38df231dbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:06.040902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e377-e59a-4cba-ac2a-e38df231dbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:06.041156 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e377-e59a-4cba-ac2a-e38df231dbe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:06.042533 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668e377-e59a-4cba-ac2a-e38df231dbe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:06.044437 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668e377-e59a-4cba-ac2a-e38df231dbe5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:06.152040 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1472/2928] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Aug 31 11:38:06 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:38:06.156489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04d2ad-21c9-48f0-88d5-82e57ae9901c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:06.166810 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04d2ad-21c9-48f0-88d5-82e57ae9901c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:06.225510 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f719f-cb83-4f61-a435-653f0bef43e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:06.226109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f719f-cb83-4f61-a435-653f0bef43e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:06.226389 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f719f-cb83-4f61-a435-653f0bef43e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:06.226707 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f719f-cb83-4f61-a435-653f0bef43e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:06.227364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f719f-cb83-4f61-a435-653f0bef43e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:06.229375 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f719f-cb83-4f61-a435-653f0bef43e1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:06.303604 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1457/2929] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Aug 31 11:38:06 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:38:06.307833 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e377-e59a-4cba-ac2a-e38df231dbe5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:06.318345 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e377-e59a-4cba-ac2a-e38df231dbe5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:06.323480 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c517-a054-48fa-a63c-b85d2b2b6924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:06.324219 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c517-a054-48fa-a63c-b85d2b2b6924 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:06.329943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c517-a054-48fa-a63c-b85d2b2b6924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:06.329943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c517-a054-48fa-a63c-b85d2b2b6924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:06.329943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207c517-a054-48fa-a63c-b85d2b2b6924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:06.329943 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207c517-a054-48fa-a63c-b85d2b2b6924 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:06.338350 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1473/2930] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:38:06.343196 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f719f-cb83-4f61-a435-653f0bef43e1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:06.353118 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f719f-cb83-4f61-a435-653f0bef43e1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:06.358541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8adfc3-f165-429f-9831-bf011d35650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:06.358541 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8adfc3-f165-429f-9831-bf011d35650d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:06.358869 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8adfc3-f165-429f-9831-bf011d35650d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:06.359139 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8adfc3-f165-429f-9831-bf011d35650d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:06.359838 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8adfc3-f165-429f-9831-bf011d35650d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:06.361401 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8adfc3-f165-429f-9831-bf011d35650d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:06.371965 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1458/2931] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Aug 31 11:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:38:06.376063 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c517-a054-48fa-a63c-b85d2b2b6924 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:06.386783 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c517-a054-48fa-a63c-b85d2b2b6924 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:06.391463 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193068bb-2064-48a5-a50b-79fc9c9406d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:06.392144 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193068bb-2064-48a5-a50b-79fc9c9406d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:06.392419 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193068bb-2064-48a5-a50b-79fc9c9406d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:06.392696 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193068bb-2064-48a5-a50b-79fc9c9406d7 admin admin] PATH_INFO: `/v3/projects/895c004e63054632a5d0db3c68458c43/users/02725140ff84420a87c28bc4aabb3aad/roles/eae8aac7335344e48b3a6e3b9ffcba0a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:06.394982 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:06.408762 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193068bb-2064-48a5-a50b-79fc9c9406d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895c004e63054632a5d0db3c68458c43, user_id=02725140ff84420a87c28bc4aabb3aad, role_id=eae8aac7335344e48b3a6e3b9ffcba0a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:06.411496 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193068bb-2064-48a5-a50b-79fc9c9406d7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:06.504085 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1474/2932] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Aug 31 11:38:06 2022] PUT /identity/v3/projects/895c004e63054632a5d0db3c68458c43/users/02725140ff84420a87c28bc4aabb3aad/roles/eae8aac7335344e48b3a6e3b9ffcba0a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:38:06.509210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c05e-f36b-4143-aa0c-522e433979af None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:06.509580 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c05e-f36b-4143-aa0c-522e433979af None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:06.509861 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c05e-f36b-4143-aa0c-522e433979af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:06.529468 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-83e8c05e-f36b-4143-aa0c-522e433979af None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:06.530864 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-83e8c05e-f36b-4143-aa0c-522e433979af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:06.590378 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1459/2933] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:06.600143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193068bb-2064-48a5-a50b-79fc9c9406d7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:06.601942 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-193068bb-2064-48a5-a50b-79fc9c9406d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:06.658021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193068bb-2064-48a5-a50b-79fc9c9406d7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:06.661678 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89029f28-c8e5-4ad0-b88e-84bbd52154fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:06.662277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89029f28-c8e5-4ad0-b88e-84bbd52154fa service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:06.662554 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89029f28-c8e5-4ad0-b88e-84bbd52154fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:06.662826 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89029f28-c8e5-4ad0-b88e-84bbd52154fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:06.671692 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89029f28-c8e5-4ad0-b88e-84bbd52154fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:06.673146 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89029f28-c8e5-4ad0-b88e-84bbd52154fa service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:06.682842 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1475/2934] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:07.823649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297efd39-8c7e-4b34-8f2d-41c3142ae093 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:07.824152 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297efd39-8c7e-4b34-8f2d-41c3142ae093 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:07.824240 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297efd39-8c7e-4b34-8f2d-41c3142ae093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:07.853409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-297efd39-8c7e-4b34-8f2d-41c3142ae093 None None] MFA Rules not processed for user `02725140ff84420a87c28bc4aabb3aad`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:07.855234 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-297efd39-8c7e-4b34-8f2d-41c3142ae093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:07.904516 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:07.933182 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1460/2935] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:38:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:07.944215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89029f28-c8e5-4ad0-b88e-84bbd52154fa service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:07.945620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-89029f28-c8e5-4ad0-b88e-84bbd52154fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:08.003616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89029f28-c8e5-4ad0-b88e-84bbd52154fa service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:08.007331 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12e9f2-cabf-4814-94cf-46da70ada060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae0faf062ba4b7a8270fc2ff92a10be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:08.007965 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12e9f2-cabf-4814-94cf-46da70ada060 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:08.008240 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12e9f2-cabf-4814-94cf-46da70ada060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:08.008509 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12e9f2-cabf-4814-94cf-46da70ada060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:08.016782 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12e9f2-cabf-4814-94cf-46da70ada060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:08.018235 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12e9f2-cabf-4814-94cf-46da70ada060 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:08.027415 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1476/2936] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:09.767395 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73fab-3d95-4497-9481-57e97576e5be None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:09.767974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73fab-3d95-4497-9481-57e97576e5be None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:09.767974 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73fab-3d95-4497-9481-57e97576e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:09.787088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c2a73fab-3d95-4497-9481-57e97576e5be None None] MFA Rules not processed for user `02725140ff84420a87c28bc4aabb3aad`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:09.788323 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c2a73fab-3d95-4497-9481-57e97576e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:09.795890 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1461/2937] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:38:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:10.036052 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12e9f2-cabf-4814-94cf-46da70ada060 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:10.046164 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12e9f2-cabf-4814-94cf-46da70ada060 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:10.049768 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04842da9-76e4-4723-b08b-0ba774f198a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:10.050352 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04842da9-76e4-4723-b08b-0ba774f198a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:10.050629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04842da9-76e4-4723-b08b-0ba774f198a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:10.050899 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04842da9-76e4-4723-b08b-0ba774f198a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:10.052629 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-04842da9-76e4-4723-b08b-0ba774f198a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:10.062614 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04842da9-76e4-4723-b08b-0ba774f198a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:10.064105 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04842da9-76e4-4723-b08b-0ba774f198a6 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:10.072413 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1477/2938] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:11.464258 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a73fab-3d95-4497-9481-57e97576e5be None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:11.465915 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c2a73fab-3d95-4497-9481-57e97576e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:11.540724 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a73fab-3d95-4497-9481-57e97576e5be None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:11.546472 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:11.547088 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:11.547368 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:11.547641 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:11.549410 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:11.561631 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:11.563210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:11.573434 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1462/2939] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:20.068822 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:21.569157 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=45 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:38:48.097157 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470511-d910-4ce6-905d-cdcf388f927b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:48.097744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470511-d910-4ce6-905d-cdcf388f927b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:48.097744 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470511-d910-4ce6-905d-cdcf388f927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:48.176487 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-53470511-d910-4ce6-905d-cdcf388f927b None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:48.177693 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-53470511-d910-4ce6-905d-cdcf388f927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:48.228056 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1478/2940] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:48.271398 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:48.272940 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:48.444362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490df32-f847-439b-83a5-273c36d1087e service placement] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:48.450924 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7875d9-6b69-4edb-9883-473106bd9e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:48.451528 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7875d9-6b69-4edb-9883-473106bd9e92 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:48.451949 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7875d9-6b69-4edb-9883-473106bd9e92 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:48.452362 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7875d9-6b69-4edb-9883-473106bd9e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:48.462874 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7875d9-6b69-4edb-9883-473106bd9e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:48.464513 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7875d9-6b69-4edb-9883-473106bd9e92 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:48.474499 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1463/2941] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:53.450019 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5ad2-a5e7-4646-96e5-b9be7a3cf3fc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:53.450570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5ad2-a5e7-4646-96e5-b9be7a3cf3fc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:53.450570 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5ad2-a5e7-4646-96e5-b9be7a3cf3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:53.470926 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-48fd5ad2-a5e7-4646-96e5-b9be7a3cf3fc None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:53.472204 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-48fd5ad2-a5e7-4646-96e5-b9be7a3cf3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:53.480008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1479/2942] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:53.502670 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7875d9-6b69-4edb-9883-473106bd9e92 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:53.504103 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1a7875d9-6b69-4edb-9883-473106bd9e92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:53.519304 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7875d9-6b69-4edb-9883-473106bd9e92 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:53.524779 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65431b3-1860-4702-bb18-2ab0174b6ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:53.525366 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65431b3-1860-4702-bb18-2ab0174b6ccc service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:53.525643 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65431b3-1860-4702-bb18-2ab0174b6ccc service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:53.525914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65431b3-1860-4702-bb18-2ab0174b6ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:53.534109 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65431b3-1860-4702-bb18-2ab0174b6ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:53.535681 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65431b3-1860-4702-bb18-2ab0174b6ccc service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:53.545008 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1464/2943] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:38:56.992653 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace13b79-b53b-4c8a-b2d8-8ccadbb395d8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:56.993279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace13b79-b53b-4c8a-b2d8-8ccadbb395d8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:56.993279 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace13b79-b53b-4c8a-b2d8-8ccadbb395d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:57.012634 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ace13b79-b53b-4c8a-b2d8-8ccadbb395d8 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:38:57.013829 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ace13b79-b53b-4c8a-b2d8-8ccadbb395d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:38:57.022216 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1480/2944] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:38:57.042361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65431b3-1860-4702-bb18-2ab0174b6ccc service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:38:57.053622 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65431b3-1860-4702-bb18-2ab0174b6ccc service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:38:57.059039 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c64593-a977-4682-9484-212a1d0b72c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:38:57.059623 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c64593-a977-4682-9484-212a1d0b72c5 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:38:57.059920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c64593-a977-4682-9484-212a1d0b72c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:38:57.060191 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c64593-a977-4682-9484-212a1d0b72c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:38:57.068402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c64593-a977-4682-9484-212a1d0b72c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:38:57.069981 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c64593-a977-4682-9484-212a1d0b72c5 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:38:57.079207 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1465/2945] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:00.930951 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa7b8a-b103-479d-92f6-fb5fb3a2aa44 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:00.931433 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa7b8a-b103-479d-92f6-fb5fb3a2aa44 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:00.931546 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa7b8a-b103-479d-92f6-fb5fb3a2aa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:00.951190 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-79fa7b8a-b103-479d-92f6-fb5fb3a2aa44 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:00.952418 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-79fa7b8a-b103-479d-92f6-fb5fb3a2aa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:00.961051 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1481/2946] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:00.989886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c64593-a977-4682-9484-212a1d0b72c5 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:01.001015 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c64593-a977-4682-9484-212a1d0b72c5 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:01.007092 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e18b4-9f69-4f6e-b8ef-03749461a092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:01.007678 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e18b4-9f69-4f6e-b8ef-03749461a092 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:01.007995 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e18b4-9f69-4f6e-b8ef-03749461a092 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:01.008270 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e18b4-9f69-4f6e-b8ef-03749461a092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:01.016256 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e18b4-9f69-4f6e-b8ef-03749461a092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:01.017829 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e18b4-9f69-4f6e-b8ef-03749461a092 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:01.027651 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1466/2947] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:05.164215 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b23fc9-3629-4d3b-a927-d5dd952b6bbc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:05.164747 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b23fc9-3629-4d3b-a927-d5dd952b6bbc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:05.164870 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b23fc9-3629-4d3b-a927-d5dd952b6bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:05.184792 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-97b23fc9-3629-4d3b-a927-d5dd952b6bbc None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:05.187309 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-97b23fc9-3629-4d3b-a927-d5dd952b6bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:05.195446 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1482/2948] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:39:05.218059 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e18b4-9f69-4f6e-b8ef-03749461a092 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:05.229329 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e18b4-9f69-4f6e-b8ef-03749461a092 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:05.234825 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07c1f1-a84c-4eeb-98f8-fb69e4586cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:05.235464 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07c1f1-a84c-4eeb-98f8-fb69e4586cdd service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:05.235693 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07c1f1-a84c-4eeb-98f8-fb69e4586cdd service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:05.235994 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07c1f1-a84c-4eeb-98f8-fb69e4586cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:05.244812 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07c1f1-a84c-4eeb-98f8-fb69e4586cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:05.246391 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07c1f1-a84c-4eeb-98f8-fb69e4586cdd service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:05.256899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1467/2949] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:09.473732 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a09af-d7b5-47c6-8acf-c1f063cfdf87 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:09.474310 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a09af-d7b5-47c6-8acf-c1f063cfdf87 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:09.474506 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a09af-d7b5-47c6-8acf-c1f063cfdf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:09.499923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8d5a09af-d7b5-47c6-8acf-c1f063cfdf87 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:09.501043 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8d5a09af-d7b5-47c6-8acf-c1f063cfdf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:09.509734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1483/2950] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:09.532898 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07c1f1-a84c-4eeb-98f8-fb69e4586cdd service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:09.544831 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07c1f1-a84c-4eeb-98f8-fb69e4586cdd service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:09.551105 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c1e8-a3dd-49e6-a4fc-e2bac59f46ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:09.551952 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c1e8-a3dd-49e6-a4fc-e2bac59f46ee service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:09.552960 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c1e8-a3dd-49e6-a4fc-e2bac59f46ee service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:09.553356 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c1e8-a3dd-49e6-a4fc-e2bac59f46ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:09.562897 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627c1e8-a3dd-49e6-a4fc-e2bac59f46ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:09.564514 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627c1e8-a3dd-49e6-a4fc-e2bac59f46ee service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:09.576549 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1468/2951] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:39:19.493639 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=60 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:19.571845 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:27.316820 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55599ba-671d-456f-8455-6dbc9b44edee None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:27.317377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55599ba-671d-456f-8455-6dbc9b44edee None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:27.317377 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55599ba-671d-456f-8455-6dbc9b44edee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:27.336572 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c55599ba-671d-456f-8455-6dbc9b44edee None None] MFA Rules not processed for user `02725140ff84420a87c28bc4aabb3aad`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:27.341716 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c55599ba-671d-456f-8455-6dbc9b44edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:27.344689 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1484/2952] 10.222.0.13 () {58 vars in 958 bytes} [Wed Aug 31 11:39:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:27.583914 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c1e8-a3dd-49e6-a4fc-e2bac59f46ee service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:27.595571 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c1e8-a3dd-49e6-a4fc-e2bac59f46ee service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:27.599357 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607814d-800c-4141-bb7d-638784ab02c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '041de16601f342c1a9b18003773a0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:27.599984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607814d-800c-4141-bb7d-638784ab02c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:27.600268 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607814d-800c-4141-bb7d-638784ab02c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:27.600542 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607814d-800c-4141-bb7d-638784ab02c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:27.602957 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0607814d-800c-4141-bb7d-638784ab02c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:27.612593 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607814d-800c-4141-bb7d-638784ab02c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:27.614043 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607814d-800c-4141-bb7d-638784ab02c3 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:27.622274 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1469/2953] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:37.331169 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:37.618485 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:39:38.937091 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55599ba-671d-456f-8455-6dbc9b44edee None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:38.958439 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55599ba-671d-456f-8455-6dbc9b44edee None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:38.965974 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bccc5-7d61-447d-b46d-41a456da1a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:38.966880 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bccc5-7d61-447d-b46d-41a456da1a51 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:38.967277 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bccc5-7d61-447d-b46d-41a456da1a51 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:38.967654 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bccc5-7d61-447d-b46d-41a456da1a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:38.969949 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-340bccc5-7d61-447d-b46d-41a456da1a51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:38.984313 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bccc5-7d61-447d-b46d-41a456da1a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:38.986143 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bccc5-7d61-447d-b46d-41a456da1a51 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:39.001536 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1485/2954] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 11:39:46.119030 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd263-a3b6-44c2-acfd-0ec9c50167a8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:46.119617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd263-a3b6-44c2-acfd-0ec9c50167a8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:46.119617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd263-a3b6-44c2-acfd-0ec9c50167a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:46.142293 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-cebcd263-a3b6-44c2-acfd-0ec9c50167a8 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:46.143591 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cebcd263-a3b6-44c2-acfd-0ec9c50167a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:46.152624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1470/2955] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:46.176538 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bccc5-7d61-447d-b46d-41a456da1a51 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:46.188316 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bccc5-7d61-447d-b46d-41a456da1a51 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:46.194002 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55ff02-4bb0-4c5a-b680-72a680baca42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:46.194651 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55ff02-4bb0-4c5a-b680-72a680baca42 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:46.194923 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55ff02-4bb0-4c5a-b680-72a680baca42 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:46.195193 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55ff02-4bb0-4c5a-b680-72a680baca42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:46.203941 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55ff02-4bb0-4c5a-b680-72a680baca42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:46.205517 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55ff02-4bb0-4c5a-b680-72a680baca42 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:46.216616 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1486/2956] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:50.695068 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ad3cc-b015-441b-a78f-34a74db85c70 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:50.695663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ad3cc-b015-441b-a78f-34a74db85c70 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:50.695663 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ad3cc-b015-441b-a78f-34a74db85c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:50.716409 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b69ad3cc-b015-441b-a78f-34a74db85c70 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:50.717624 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b69ad3cc-b015-441b-a78f-34a74db85c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:50.725702 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1471/2957] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:50.747232 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55ff02-4bb0-4c5a-b680-72a680baca42 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:50.759209 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55ff02-4bb0-4c5a-b680-72a680baca42 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:50.765021 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e621f2-8f93-415c-a4bf-8fcb8c9b7b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:50.765620 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e621f2-8f93-415c-a4bf-8fcb8c9b7b9e service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:50.765893 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e621f2-8f93-415c-a4bf-8fcb8c9b7b9e service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:50.766161 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e621f2-8f93-415c-a4bf-8fcb8c9b7b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:50.775486 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e621f2-8f93-415c-a4bf-8fcb8c9b7b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:50.777170 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e621f2-8f93-415c-a4bf-8fcb8c9b7b9e service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:50.787008 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1487/2958] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:50.985388 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ad3cc-b015-441b-a78f-34a74db85c70 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:51.008443 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ad3cc-b015-441b-a78f-34a74db85c70 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:51.013759 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615bfef-7bb1-4a31-beea-3fe02fa6e598 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:51.014361 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615bfef-7bb1-4a31-beea-3fe02fa6e598 service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:51.014642 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615bfef-7bb1-4a31-beea-3fe02fa6e598 service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:51.014920 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615bfef-7bb1-4a31-beea-3fe02fa6e598 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:51.016726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c615bfef-7bb1-4a31-beea-3fe02fa6e598 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:51.042114 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615bfef-7bb1-4a31-beea-3fe02fa6e598 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:51.047035 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615bfef-7bb1-4a31-beea-3fe02fa6e598 service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:51.054402 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1472/2959] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:39:54.609655 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23461eaf-25d0-482a-89ed-a5088217fe4a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:54.610206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23461eaf-25d0-482a-89ed-a5088217fe4a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:54.610206 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23461eaf-25d0-482a-89ed-a5088217fe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:54.630343 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-23461eaf-25d0-482a-89ed-a5088217fe4a None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:39:54.631589 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-23461eaf-25d0-482a-89ed-a5088217fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:39:54.640332 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1488/2960] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:39:54.662279 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615bfef-7bb1-4a31-beea-3fe02fa6e598 service placement] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:39:54.675489 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615bfef-7bb1-4a31-beea-3fe02fa6e598 service placement] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:39:54.682099 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8323835-002f-4156-9c39-abc1dd9df061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:39:54.682707 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8323835-002f-4156-9c39-abc1dd9df061 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:39:54.682984 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8323835-002f-4156-9c39-abc1dd9df061 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:39:54.683255 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8323835-002f-4156-9c39-abc1dd9df061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:39:54.692042 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8323835-002f-4156-9c39-abc1dd9df061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:39:54.693704 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8323835-002f-4156-9c39-abc1dd9df061 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:39:54.703451 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1473/2961] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:00.935188 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0d6f1-16ce-45d0-a312-f89b60857203 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:00.935810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0d6f1-16ce-45d0-a312-f89b60857203 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:00.935810 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0d6f1-16ce-45d0-a312-f89b60857203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:00.955902 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-aff0d6f1-16ce-45d0-a312-f89b60857203 None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:00.957099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-aff0d6f1-16ce-45d0-a312-f89b60857203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:00.966988 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1489/2962] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:00.990645 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8323835-002f-4156-9c39-abc1dd9df061 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:01.002436 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8323835-002f-4156-9c39-abc1dd9df061 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:01.008786 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bb22d-f3ae-41da-9014-014321b7aa5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:01.009282 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb22d-f3ae-41da-9014-014321b7aa5d service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:01.009511 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb22d-f3ae-41da-9014-014321b7aa5d service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:01.009886 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bb22d-f3ae-41da-9014-014321b7aa5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:01.021658 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bb22d-f3ae-41da-9014-014321b7aa5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:01.023285 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bb22d-f3ae-41da-9014-014321b7aa5d service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:01.034709 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1474/2963] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:05.230884 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486479d6-5bab-4c93-8d6a-b0d6fc7c40da None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:05.231430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486479d6-5bab-4c93-8d6a-b0d6fc7c40da None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:05.231430 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486479d6-5bab-4c93-8d6a-b0d6fc7c40da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:05.251800 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-486479d6-5bab-4c93-8d6a-b0d6fc7c40da None None] MFA Rules not processed for user `4130eba1ceda435c8baed39723df5c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:40:05.253014 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-486479d6-5bab-4c93-8d6a-b0d6fc7c40da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:05.261128 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1490/2964] 10.222.0.25 () {58 vars in 1016 bytes} [Wed Aug 31 11:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:40:05.284876 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bb22d-f3ae-41da-9014-014321b7aa5d service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:05.297084 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bb22d-f3ae-41da-9014-014321b7aa5d service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:05.302486 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29b82-1166-4cf2-ad0d-cc26cd41f491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c5d8bbcf07486ea3d3e26c81135d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:05.303071 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29b82-1166-4cf2-ad0d-cc26cd41f491 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:05.303345 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29b82-1166-4cf2-ad0d-cc26cd41f491 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:05.303614 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29b82-1166-4cf2-ad0d-cc26cd41f491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:05.312019 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd29b82-1166-4cf2-ad0d-cc26cd41f491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:05.313875 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd29b82-1166-4cf2-ad0d-cc26cd41f491 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:05.339241 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1475/2965] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:15.246225 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=27 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:15.333617 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=39 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:44.207921 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486479d6-5bab-4c93-8d6a-b0d6fc7c40da None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:44.220500 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486479d6-5bab-4c93-8d6a-b0d6fc7c40da None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:44.225764 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54712ff-9aad-471f-8980-9b5f17e27773 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:44.226429 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54712ff-9aad-471f-8980-9b5f17e27773 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:44.226710 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54712ff-9aad-471f-8980-9b5f17e27773 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:44.226984 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54712ff-9aad-471f-8980-9b5f17e27773 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:44.228847 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c54712ff-9aad-471f-8980-9b5f17e27773 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:40:44.241191 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54712ff-9aad-471f-8980-9b5f17e27773 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:44.243293 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54712ff-9aad-471f-8980-9b5f17e27773 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:44.254787 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1491/2966] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:40:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:40:44.323899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29b82-1166-4cf2-ad0d-cc26cd41f491 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:44.334060 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29b82-1166-4cf2-ad0d-cc26cd41f491 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:44.338822 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:44.339445 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:44.339763 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:44.340054 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] PATH_INFO: `/v3/users/02725140ff84420a87c28bc4aabb3aad` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:44.341171 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02725140ff84420a87c28bc4aabb3aad)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:44.343225 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:44.508726 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02725140ff84420a87c28bc4aabb3aad'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:44.516283 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02725140ff84420a87c28bc4aabb3aad'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:44.528138 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02725140ff84420a87c28bc4aabb3aad'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:44.532352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02725140ff84420a87c28bc4aabb3aad'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:44.532352 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02725140ff84420a87c28bc4aabb3aad'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:44.672649 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1476/2967] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Aug 31 11:40:44 2022] DELETE /identity/v3/users/02725140ff84420a87c28bc4aabb3aad => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:40:45.051212 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54712ff-9aad-471f-8980-9b5f17e27773 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:40:45.064804 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54712ff-9aad-471f-8980-9b5f17e27773 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:40:45.131688 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4130eba1ceda435c8baed39723df5c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa445d84b8134f39a7735cb2fc7c685b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:40:45.136721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:40:45.136721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:40:45.136721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] PATH_INFO: `/v3/projects/895c004e63054632a5d0db3c68458c43` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:40:45.136721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=895c004e63054632a5d0db3c68458c43)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:40:45.136721 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:40:45.292000 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895c004e63054632a5d0db3c68458c43', 'request_id': 'req-348ae2fb-b214-4a32-a9c4-0a88374c0fab'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:45.298750 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895c004e63054632a5d0db3c68458c43', 'request_id': 'req-348ae2fb-b214-4a32-a9c4-0a88374c0fab'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:45.304733 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895c004e63054632a5d0db3c68458c43', 'request_id': 'req-348ae2fb-b214-4a32-a9c4-0a88374c0fab'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:45.455447 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] The token cache is being invalidate because project 895c004e63054632a5d0db3c68458c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:40:45.455734 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:45.456401 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-348ae2fb-b214-4a32-a9c4-0a88374c0fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:40:45.457892 dv-cinder-855350-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1492/2968] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Aug 31 11:40:45 2022] DELETE /identity/v3/projects/895c004e63054632a5d0db3c68458c43 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:40:54.668767 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:55.452099 dv-cinder-855350-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:52.877935 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:44:52.879364 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:52.950654 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4c9ba-6f44-42d4-8a36-270d0dd3387e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:44:53.012248 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27e820-4218-48fc-b1b3-4c64c5c2e1b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cacc0855973047b6a97e40b5f32a8cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88e59bcfd667410fbeb00ffdce6a8bca', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:44:53.012859 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27e820-4218-48fc-b1b3-4c64c5c2e1b7 service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:44:53.013138 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27e820-4218-48fc-b1b3-4c64c5c2e1b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:44:53.013404 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27e820-4218-48fc-b1b3-4c64c5c2e1b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:44:53.015210 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cd27e820-4218-48fc-b1b3-4c64c5c2e1b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:44:53.026296 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27e820-4218-48fc-b1b3-4c64c5c2e1b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:44:53.027899 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27e820-4218-48fc-b1b3-4c64c5c2e1b7 service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:44:53.038143 dv-cinder-855350-1-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1477/2969] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Aug 31 11:44:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:45:03.038589 dv-cinder-855350-1-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=58 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}